Oct 29 23:12:50.945108 ip-10-0-143-10 systemd[1]: Starting Kubernetes Kubelet... Oct 29 23:12:51.390923 ip-10-0-143-10 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:51.390923 ip-10-0-143-10 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 29 23:12:51.390923 ip-10-0-143-10 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:51.390923 ip-10-0-143-10 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:12:51.396393 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396310 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.396393 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396392 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396397 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396401 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396403 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396406 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396409 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396411 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396414 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396417 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396421 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396423 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396426 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396429 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396431 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396434 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396436 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396439 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396443 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396447 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.396465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396450 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396452 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396455 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396458 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396460 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396462 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396465 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396468 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396471 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396474 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396477 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396480 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396482 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396485 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396487 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396490 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396492 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396495 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396497 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396500 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.396942 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396502 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396505 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396507 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396514 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396517 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396519 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396522 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396524 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396527 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396529 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396531 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396535 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396539 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396543 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396546 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396549 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396551 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396555 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396558 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.397405 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396560 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396563 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396565 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396568 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396570 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396573 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396575 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396578 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396580 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396583 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396586 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396588 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396591 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396593 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396596 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396599 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396601 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396609 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396612 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.398713 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396615 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396617 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396620 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396622 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396624 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396627 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396629 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396633 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396636 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396639 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396641 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396644 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396646 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396650 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396653 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396655 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396658 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396660 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396663 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396665 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.399169 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396668 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396670 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396673 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396675 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396677 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396680 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396682 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.396685 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397469 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397476 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397479 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397483 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397486 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397489 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397492 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397494 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397497 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397500 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397502 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397506 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.399662 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397508 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397511 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397514 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397518 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397522 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397525 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397527 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397530 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397533 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397536 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397538 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397541 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397543 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397546 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397548 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397551 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397554 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397557 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397559 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.400191 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397562 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397565 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397567 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397570 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397573 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397576 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397579 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397581 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397584 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397587 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397589 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397592 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397594 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397597 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397600 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397602 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397604 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397607 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397610 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397612 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.400660 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397615 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397617 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397619 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397622 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397627 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397631 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397635 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397638 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397641 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397643 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397646 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397648 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397651 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397653 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397656 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397658 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397662 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397664 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397667 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.401158 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397670 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397672 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397675 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397677 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397680 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397682 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397685 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397687 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397690 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397692 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397695 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397697 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397700 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397702 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397705 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397707 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397710 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397712 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397715 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397717 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.401647 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397720 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397723 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397725 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397728 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397730 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397733 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397735 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397738 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397741 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397743 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397746 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397749 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397753 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397755 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397758 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.397760 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398951 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398959 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398962 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.402140 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398967 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398971 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398975 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398978 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398981 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398983 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398986 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398989 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398992 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398994 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.398997 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399000 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399002 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399005 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399008 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399014 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399016 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399019 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399021 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399024 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.402589 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399027 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399029 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399032 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399034 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399037 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399041 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399044 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399046 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399049 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399051 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399054 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399057 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399059 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399062 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399064 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399067 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399069 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399072 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399074 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.403089 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399077 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399079 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399081 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399084 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399086 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399089 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399092 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399095 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399100 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399103 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399106 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399108 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399111 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399114 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399116 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399119 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399121 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399123 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399126 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399129 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.403532 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399131 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399134 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399136 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399139 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399141 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399144 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399146 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399149 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399151 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399154 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399156 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399159 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399161 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399164 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399166 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399168 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399171 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399178 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399181 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.404087 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399184 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399187 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399190 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399192 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399195 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399198 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399200 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399203 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399205 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399208 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399210 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399212 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399215 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399218 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399220 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399223 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399225 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399228 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399231 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399234 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.404531 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399236 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399239 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399241 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399244 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.399246 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400307 2580 flags.go:64] FLAG: --address="0.0.0.0" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400318 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400325 2580 flags.go:64] FLAG: --anonymous-auth="true" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400329 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400333 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400340 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400344 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400348 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400359 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400363 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400366 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400370 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400373 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400376 2580 flags.go:64] FLAG: --cgroup-root="" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400378 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400382 2580 flags.go:64] FLAG: --client-ca-file="" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400384 2580 flags.go:64] FLAG: --cloud-provider="external" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400387 2580 flags.go:64] FLAG: --cluster-dns="[]" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400391 2580 flags.go:64] FLAG: --cluster-domain="" Oct 29 23:12:51.405027 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400393 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400396 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400401 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400404 2580 flags.go:64] FLAG: --container-log-max-files="5" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400408 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400411 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400414 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400417 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400421 2580 flags.go:64] FLAG: --contention-profiling="false" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400424 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400426 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400429 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400432 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400437 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400440 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400443 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400446 2580 flags.go:64] FLAG: --enable-load-reader="false" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400449 2580 flags.go:64] FLAG: --enable-server="true" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400453 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400457 2580 flags.go:64] FLAG: --event-burst="100" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400460 2580 flags.go:64] FLAG: --event-qps="50" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400464 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400467 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400470 2580 flags.go:64] FLAG: --eviction-hard="" Oct 29 23:12:51.405599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400474 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400477 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400481 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400484 2580 flags.go:64] FLAG: --eviction-soft="" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400487 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400490 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400493 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400496 2580 flags.go:64] FLAG: --experimental-mounter-path="" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400499 2580 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400501 2580 flags.go:64] FLAG: --fail-swap-on="true" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400504 2580 flags.go:64] FLAG: --feature-gates="" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400510 2580 flags.go:64] FLAG: --file-check-frequency="20s" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400513 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400516 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400519 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400522 2580 flags.go:64] FLAG: --healthz-port="10248" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400525 2580 flags.go:64] FLAG: --help="false" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400528 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400531 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400534 2580 flags.go:64] FLAG: --http-check-frequency="20s" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400537 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400541 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400544 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400547 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 29 23:12:51.406261 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400549 2580 flags.go:64] FLAG: --image-service-endpoint="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400552 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400556 2580 flags.go:64] FLAG: --kube-api-burst="100" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400560 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400563 2580 flags.go:64] FLAG: --kube-api-qps="50" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400566 2580 flags.go:64] FLAG: --kube-reserved="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400569 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400572 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400575 2580 flags.go:64] FLAG: --kubelet-cgroups="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400578 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400581 2580 flags.go:64] FLAG: --lock-file="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400583 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400587 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400590 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400595 2580 flags.go:64] FLAG: --log-json-split-stream="false" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400598 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400601 2580 flags.go:64] FLAG: --log-text-split-stream="false" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400604 2580 flags.go:64] FLAG: --logging-format="text" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400607 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400611 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400614 2580 flags.go:64] FLAG: --manifest-url="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400617 2580 flags.go:64] FLAG: --manifest-url-header="" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400621 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400625 2580 flags.go:64] FLAG: --max-open-files="1000000" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400628 2580 flags.go:64] FLAG: --max-pods="110" Oct 29 23:12:51.406928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400631 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400634 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400637 2580 flags.go:64] FLAG: --memory-manager-policy="None" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400640 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400643 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400646 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400649 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400656 2580 flags.go:64] FLAG: --node-status-max-images="50" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400659 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400663 2580 flags.go:64] FLAG: --oom-score-adj="-999" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400667 2580 flags.go:64] FLAG: --pod-cidr="" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400671 2580 flags.go:64] FLAG: --pod-manifest-path="" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400674 2580 flags.go:64] FLAG: --pod-max-pids="-1" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400678 2580 flags.go:64] FLAG: --pods-per-core="0" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400680 2580 flags.go:64] FLAG: --port="10250" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400683 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400686 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d6c99b4308cff0e" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400689 2580 flags.go:64] FLAG: --qos-reserved="" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400692 2580 flags.go:64] FLAG: --read-only-port="10255" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400696 2580 flags.go:64] FLAG: --register-node="true" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400699 2580 flags.go:64] FLAG: --register-with-taints="" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400702 2580 flags.go:64] FLAG: --registry-burst="10" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400705 2580 flags.go:64] FLAG: --registry-qps="5" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400708 2580 flags.go:64] FLAG: --reserved-cpus="" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400711 2580 flags.go:64] FLAG: --reserved-memory="" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400715 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 29 23:12:51.407870 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400718 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400721 2580 flags.go:64] FLAG: --rotate-certificates="false" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400724 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400727 2580 flags.go:64] FLAG: --runonce="false" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400730 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400733 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400736 2580 flags.go:64] FLAG: --seccomp-default="false" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400739 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400742 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400745 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400748 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400751 2580 flags.go:64] FLAG: --storage-driver-password="root" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400754 2580 flags.go:64] FLAG: --storage-driver-secure="false" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400757 2580 flags.go:64] FLAG: --storage-driver-table="stats" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400759 2580 flags.go:64] FLAG: --storage-driver-user="root" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400764 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400767 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400771 2580 flags.go:64] FLAG: --system-cgroups="" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400774 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400779 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400782 2580 flags.go:64] FLAG: --tls-cert-file="" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400785 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400788 2580 flags.go:64] FLAG: --tls-min-version="" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400791 2580 flags.go:64] FLAG: --tls-private-key-file="" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400794 2580 flags.go:64] FLAG: --topology-manager-policy="none" Oct 29 23:12:51.408643 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400797 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400800 2580 flags.go:64] FLAG: --topology-manager-scope="container" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400802 2580 flags.go:64] FLAG: --v="2" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400810 2580 flags.go:64] FLAG: --version="false" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400814 2580 flags.go:64] FLAG: --vmodule="" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400818 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.400821 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400959 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400963 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400966 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400969 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400972 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400975 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400977 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400980 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400982 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400985 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400987 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400990 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400992 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400995 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.409277 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.400998 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401001 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401004 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401008 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401010 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401013 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401016 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401018 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401021 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401023 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401026 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401028 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401031 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401033 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401036 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401039 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401041 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401044 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401048 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.409770 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401052 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401055 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401058 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401064 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401066 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401069 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401071 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401074 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401077 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401079 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401082 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401085 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401087 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401090 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401094 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401097 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401101 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401103 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401106 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.410241 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401108 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401111 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401113 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401116 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401118 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401121 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401123 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401126 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401129 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401131 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401134 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401136 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401139 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401141 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401144 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401146 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401149 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401152 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401155 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401157 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.410693 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401160 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401163 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401165 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401168 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401171 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401175 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401178 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401182 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401185 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401189 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401191 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401194 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401196 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401199 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401201 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401204 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401207 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401209 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401212 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.411230 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401214 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401217 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401219 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401222 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401224 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401227 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401230 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401232 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401235 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401237 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401240 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401243 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401245 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401248 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401250 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.401276 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:51.411677 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401314 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401318 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401322 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401325 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401327 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401330 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401335 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401337 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401340 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401343 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401345 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401348 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401351 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401353 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401356 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401358 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401361 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401363 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401366 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.412070 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401368 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401371 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401373 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401376 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401378 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401380 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401383 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401385 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401388 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401391 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401393 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401396 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401398 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401401 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401403 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401406 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401408 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401410 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401413 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401417 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.412527 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401420 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401422 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401426 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401429 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401432 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401435 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401439 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401442 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401444 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401447 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401449 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401452 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401454 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401457 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401460 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401462 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401465 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401467 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401470 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.413003 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401472 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401474 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401477 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401481 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401483 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401486 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401489 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401491 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401494 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401496 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401499 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401501 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401505 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401507 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401510 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401512 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401515 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401517 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401519 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401522 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.413450 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401524 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401527 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401529 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401532 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401534 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401537 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401540 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401543 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401545 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401547 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401550 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401552 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401555 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401557 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401560 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401563 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401566 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401569 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401571 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401574 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.414557 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401576 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401579 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401582 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401584 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401590 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401594 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401597 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.401600 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.409779 2580 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.409795 2580 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.409816 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.409821 2580 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409897 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409903 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409907 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409909 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409912 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409915 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.415024 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409918 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409921 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409924 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409926 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409929 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409931 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409934 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409937 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409939 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409942 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409946 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409948 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409951 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409953 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409955 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409958 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409961 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409964 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409967 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409969 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.415436 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409972 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409974 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409984 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409987 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409989 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409992 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409994 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.409997 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410000 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410002 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410005 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410007 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410010 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410012 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410014 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410017 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410019 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410022 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410024 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.415928 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410027 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410029 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410032 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410034 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410037 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410040 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410042 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410044 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410047 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410049 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410052 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410056 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410060 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410063 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410066 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410069 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410072 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410074 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410077 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.416374 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410080 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410082 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410084 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410087 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410089 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410092 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410095 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410097 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410100 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410102 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410105 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410108 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410110 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410112 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410115 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410118 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410121 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410124 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410126 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410129 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.416862 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410132 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410135 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410137 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410140 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410142 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410145 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410148 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410150 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410153 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410156 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410158 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410161 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410163 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410166 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410168 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410171 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410174 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410178 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410181 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.417354 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410184 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410186 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410189 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.410216 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410351 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410357 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410360 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410363 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410366 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410369 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410372 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410375 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410377 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410380 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410382 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410385 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.417792 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410387 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410390 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410393 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410395 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410398 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410400 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410403 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410406 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410408 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410411 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410413 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410416 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410419 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410422 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410424 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410427 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410430 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410432 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410435 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410437 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.418189 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410440 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410442 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410446 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410450 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410453 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410456 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410460 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410462 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410465 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410467 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410470 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410472 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410475 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410478 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410480 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410483 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410485 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410487 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410490 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410493 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.418654 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410495 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410498 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410500 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410503 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410505 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410508 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410511 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410515 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410517 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410520 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410523 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410525 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410528 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410530 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410533 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410536 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410538 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410541 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410543 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.419229 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410546 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410549 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410552 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410556 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410559 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410562 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410565 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410569 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410572 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410575 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410577 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410580 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410583 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410586 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410588 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410591 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410593 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410596 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410598 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.419691 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410601 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410605 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410607 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410610 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410612 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410615 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410617 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410620 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410623 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410625 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410628 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410630 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410633 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410635 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410639 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410641 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.420148 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.410664 2580 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410695 2580 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410701 2580 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410704 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410707 2580 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410710 2580 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410713 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410716 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410718 2580 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410721 2580 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410723 2580 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410726 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410729 2580 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410732 2580 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410735 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410737 2580 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410740 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410742 2580 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410746 2580 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:12:51.420525 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410750 2580 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410753 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410755 2580 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410758 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410760 2580 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410763 2580 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410765 2580 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410768 2580 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410771 2580 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410773 2580 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410776 2580 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410778 2580 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410784 2580 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410787 2580 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410790 2580 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410793 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410795 2580 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410798 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410800 2580 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410803 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:12:51.420991 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410805 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410808 2580 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410810 2580 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410813 2580 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410816 2580 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410818 2580 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410820 2580 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410823 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410825 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410828 2580 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410845 2580 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410850 2580 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410854 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410856 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410860 2580 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410862 2580 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410865 2580 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410868 2580 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410870 2580 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410873 2580 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:12:51.421465 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410876 2580 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410879 2580 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410881 2580 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410884 2580 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410886 2580 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410890 2580 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410892 2580 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410895 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410897 2580 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410902 2580 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410905 2580 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410909 2580 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410911 2580 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410914 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410917 2580 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410919 2580 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410922 2580 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410924 2580 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410927 2580 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:12:51.421995 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410929 2580 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410932 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410934 2580 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410937 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410941 2580 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410944 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410947 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410950 2580 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410952 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410955 2580 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410957 2580 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410960 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410962 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410965 2580 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410967 2580 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410970 2580 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410972 2580 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410975 2580 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410977 2580 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410980 2580 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:12:51.422468 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410983 2580 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410985 2580 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410988 2580 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410990 2580 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410993 2580 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410995 2580 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.410998 2580 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.411000 2580 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:51.411003 2580 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.411059 2580 server.go:957] "Client rotation is on, will bootstrap in background" Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.413066 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.414000 2580 server.go:1014] "Starting client certificate rotation" Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.414097 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.414131 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.416087 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:12:51.422988 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.417181 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:12:51.427595 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.427581 2580 log.go:25] "Validated CRI v1 runtime API" Oct 29 23:12:51.430871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.430857 2580 log.go:25] "Validated CRI v1 image API" Oct 29 23:12:51.431728 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.431705 2580 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 29 23:12:51.434653 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.434636 2580 fs.go:135] Filesystem UUIDs: map[52f5c5ec-e1d9-4222-b047-d1b20b5554e8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f84dfab7-edfd-4b7c-a795-333d4e901eed:/dev/nvme0n1p3] Oct 29 23:12:51.434712 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.434653 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 29 23:12:51.441379 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.441274 2580 manager.go:217] Machine: {Timestamp:2026-10-29 23:12:51.438131019 +0000 UTC m=+0.361907963 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110030 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21649f061827b3df135b87ee6981c0 SystemUUID:ec21649f-0618-27b3-df13-5b87ee6981c0 BootID:17bce9fc-054b-44ac-a8e4-e5ce65eb7504 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f2:4d:af:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f2:4d:af:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:44:54:d8:9d:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 29 23:12:51.441379 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.441379 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 29 23:12:51.442392 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.442357 2580 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 29 23:12:51.446333 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.446164 2580 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 29 23:12:51.446480 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.446336 2580 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 29 23:12:51.447206 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.447195 2580 topology_manager.go:143] "Creating topology manager with none policy" Oct 29 23:12:51.447245 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.447209 2580 container_manager_linux.go:311] "Creating device plugin manager" Oct 29 23:12:51.447245 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.447221 2580 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:12:51.447245 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.447232 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:12:51.448141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.448131 2580 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 29 23:12:51.452094 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452082 2580 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 29 23:12:51.452211 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452202 2580 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 29 23:12:51.452959 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452950 2580 kubelet.go:493] "Attempting to sync node with API server" Oct 29 23:12:51.452996 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452963 2580 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 29 23:12:51.452996 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452974 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 29 23:12:51.452996 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452983 2580 kubelet.go:405] "Adding apiserver pod source" Oct 29 23:12:51.452996 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.452990 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 29 23:12:51.453288 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.453275 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:12:51.455752 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.455729 2580 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 29 23:12:51.460329 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.460313 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:12:51.461194 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.461180 2580 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 29 23:12:51.461266 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.461220 2580 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 29 23:12:51.462258 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.462245 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 29 23:12:51.462324 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.462265 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 29 23:12:51.462324 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.462275 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 29 23:12:51.462324 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.462284 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 29 23:12:51.462324 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.462293 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 29 23:12:51.462324 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.462302 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 29 23:12:51.463281 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.463271 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 29 23:12:51.463340 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.463284 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 29 23:12:51.463340 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.463296 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 29 23:12:51.463340 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.463306 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 29 23:12:51.463340 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.463319 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 29 23:12:51.463340 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.463334 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 29 23:12:51.464996 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.464983 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 29 23:12:51.465051 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.464999 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 29 23:12:51.468666 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.468650 2580 server.go:1263] "Started kubelet" Oct 29 23:12:51.468766 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.468736 2580 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 29 23:12:51.468812 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.468747 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 29 23:12:51.468874 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.468847 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 29 23:12:51.469416 ip-10-0-143-10 systemd[1]: Started Kubernetes Kubelet. Oct 29 23:12:51.470207 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.470188 2580 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 29 23:12:51.471478 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.471462 2580 server.go:317] "Adding debug handlers to kubelet server" Oct 29 23:12:51.475674 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.475649 2580 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 29 23:12:51.477400 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.477380 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 29 23:12:51.478633 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.478618 2580 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 29 23:12:51.478743 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.478728 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:51.479217 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479195 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 29 23:12:51.479320 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479196 2580 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 29 23:12:51.479320 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479320 2580 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 29 23:12:51.479469 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479454 2580 reconstruct.go:97] "Volume reconstruction finished" Oct 29 23:12:51.479469 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479469 2580 reconciler.go:29] "Reconciler: start to sync state" Oct 29 23:12:51.479635 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479624 2580 factory.go:153] Registering CRI-O factory Oct 29 23:12:51.479677 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479637 2580 factory.go:223] Registration of the crio container factory successfully Oct 29 23:12:51.479677 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479676 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 29 23:12:51.479733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479682 2580 factory.go:55] Registering systemd factory Oct 29 23:12:51.479733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479690 2580 factory.go:223] Registration of the systemd container factory successfully Oct 29 23:12:51.479733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479705 2580 factory.go:103] Registering Raw factory Oct 29 23:12:51.479733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.479716 2580 manager.go:1199] Started watching for new ooms in manager Oct 29 23:12:51.480922 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.480768 2580 manager.go:319] Starting recovery of all containers Oct 29 23:12:51.488255 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.488221 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 29 23:12:51.496340 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.496323 2580 manager.go:324] Recovery completed Oct 29 23:12:51.500273 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.500258 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.501893 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.501871 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.501976 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.501911 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.501976 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.501926 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.502455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.502443 2580 cpu_manager.go:226] "Starting" policy="none" Oct 29 23:12:51.502455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.502453 2580 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 29 23:12:51.502539 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.502468 2580 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 29 23:12:51.502539 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.502511 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.503251 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.503228 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.503334 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.503256 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.503334 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.503270 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.504658 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.504642 2580 policy_none.go:50] "Start" Oct 29 23:12:51.504658 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.504660 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 29 23:12:51.504807 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.504676 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 29 23:12:51.505242 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.505223 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-10.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 29 23:12:51.505313 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.505216 2580 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 29 23:12:51.506322 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.505208 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18e32302c790632c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-10-29 23:12:51.468624684 +0000 UTC m=+0.392401627,LastTimestamp:2026-10-29 23:12:51.468624684 +0000 UTC m=+0.392401627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Oct 29 23:12:51.506689 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.506678 2580 policy_none.go:44] "Start" Oct 29 23:12:51.511118 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.511101 2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 29 23:12:51.511190 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.511151 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mpb99" Oct 29 23:12:51.519968 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.519943 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 29 23:12:51.520142 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.520065 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18e32302c98c0709 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-10-29 23:12:51.501893385 +0000 UTC m=+0.425670336,LastTimestamp:2026-10-29 23:12:51.501893385 +0000 UTC m=+0.425670336,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Oct 29 23:12:51.520233 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.520172 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 29 23:12:51.520233 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.520189 2580 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 29 23:12:51.521995 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.521971 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mpb99" Oct 29 23:12:51.541386 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.541353 2580 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 29 23:12:51.543925 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.543903 2580 manager.go:341] "Starting Device Plugin manager" Oct 29 23:12:51.544546 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.544523 2580 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 29 23:12:51.544546 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.544547 2580 server.go:87] "Starting device plugin registration server" Oct 29 23:12:51.544791 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.544778 2580 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 29 23:12:51.544866 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.544793 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 29 23:12:51.544919 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.544882 2580 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 29 23:12:51.544963 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.544947 2580 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 29 23:12:51.544963 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.544955 2580 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 29 23:12:51.545410 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.545389 2580 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 29 23:12:51.545478 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.545430 2580 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:51.547163 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.547091 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18e32302c98c66f7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-10.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-10-29 23:12:51.501917943 +0000 UTC m=+0.425694886,LastTimestamp:2026-10-29 23:12:51.501917943 +0000 UTC m=+0.425694886,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Oct 29 23:12:51.560929 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.560854 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18e32302c98c9e19 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-10.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-10-29 23:12:51.501932057 +0000 UTC m=+0.425709004,LastTimestamp:2026-10-29 23:12:51.501932057 +0000 UTC m=+0.425709004,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Oct 29 23:12:51.595342 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.595275 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-10.ec2.internal.18e32302c98c0709\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18e32302c98c0709 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-10-29 23:12:51.501893385 +0000 UTC m=+0.425670336,LastTimestamp:2026-10-29 23:12:51.503243251 +0000 UTC m=+0.427020201,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Oct 29 23:12:51.636990 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.599788 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 29 23:12:51.636990 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.600325 2580 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 29 23:12:51.636990 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.600356 2580 kubelet.go:2521] "Starting kubelet main sync loop" Oct 29 23:12:51.636990 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.600394 2580 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 29 23:12:51.636990 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.633103 2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-10.ec2.internal.18e32302c98c66f7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18e32302c98c66f7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-10.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-10-29 23:12:51.501917943 +0000 UTC m=+0.425694886,LastTimestamp:2026-10-29 23:12:51.503265179 +0000 UTC m=+0.427042123,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Oct 29 23:12:51.645260 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.645223 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.645924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.645897 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.646008 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.645928 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.646008 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.645942 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.646008 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.645967 2580 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.673528 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.673506 2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:51.680363 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.680339 2580 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.680439 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.680366 2580 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-10.ec2.internal\": node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:51.700484 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.700465 2580 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal"] Oct 29 23:12:51.700566 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.700515 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.701259 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.701242 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.701313 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.701271 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.701313 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.701286 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.703424 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.703412 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.703587 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.703573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.703624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.703601 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.704194 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.704177 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.704194 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.704191 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.704323 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.704204 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.704323 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.704214 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.704323 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.704216 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.704323 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.704230 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.706246 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.706231 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.706328 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.706259 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:51.706964 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.706948 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:51.707045 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.706969 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:51.707045 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.706978 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:51.723151 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.723137 2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-10.ec2.internal\" not found" node="ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.724136 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.724117 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:51.726445 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.726427 2580 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-10.ec2.internal\" not found" node="ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.780989 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.780968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.781085 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.780994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.781085 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.781010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb762aa62d1c58eba273642f34f2f74a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"cb762aa62d1c58eba273642f34f2f74a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.825119 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.825097 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:51.881560 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.881536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.881663 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.881561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb762aa62d1c58eba273642f34f2f74a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"cb762aa62d1c58eba273642f34f2f74a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.881663 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.881579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.881663 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.881625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.881663 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.881639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.881801 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:51.881657 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb762aa62d1c58eba273642f34f2f74a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"cb762aa62d1c58eba273642f34f2f74a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:12:51.926130 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:51.926082 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:52.026897 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:52.026870 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:52.027017 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:52.026904 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:52.030110 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:52.030096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:12:52.127211 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:52.127060 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:52.227566 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:52.227516 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:53.428401 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:53.428380 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:53.513910 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.513887 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 29 23:12:53.514276 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.514009 2580 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 29 23:12:53.529187 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:53.529168 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:53.629516 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:53.629488 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:53.674057 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.674035 2580 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:53.698309 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.698277 2580 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:12:53.699006 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:53.698979 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb762aa62d1c58eba273642f34f2f74a.slice/crio-77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3 WatchSource:0}: Error finding container 77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3: Status 404 returned error can't find the container with id 77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3 Oct 29 23:12:53.699259 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:53.699234 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca642e2900464b7ec6ed2498b328dcb.slice/crio-cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477 WatchSource:0}: Error finding container cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477: Status 404 returned error can't find the container with id cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477 Oct 29 23:12:53.699455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.699440 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:12:53.699509 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.699471 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:12:53.699509 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.699482 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:12:53.704403 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.704390 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:12:53.730497 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:53.730476 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:53.742089 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.742061 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:52 +0000 UTC" deadline="2028-05-06 13:45:53.345744013 +0000 UTC" Oct 29 23:12:53.742089 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:53.742085 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13310h32m59.603663119s" Oct 29 23:12:53.830988 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:53.830959 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:53.931423 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:53.931372 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:54.032001 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.031975 2580 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:12:54.094239 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.094222 2580 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:54.104194 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.104169 2580 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:54.179522 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.179492 2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:12:54.203214 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.203163 2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:12:54.204177 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.204148 2580 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:12:54.222957 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.222936 2580 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:12:54.554665 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.554362 2580 apiserver.go:52] "Watching apiserver" Oct 29 23:12:54.579350 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.579324 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 29 23:12:54.594963 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.594937 2580 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 29 23:12:54.595330 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.595304 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-xnstf","openshift-ovn-kubernetes/ovnkube-node-sg8lq","kube-system/global-pull-secret-syncer-rrcsq","kube-system/konnectivity-agent-kdkfv","kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal","openshift-network-operator/iptables-alerter-ghx8k","openshift-cluster-node-tuning-operator/tuned-x5g6d","openshift-dns/node-resolver-4qzft","openshift-image-registry/node-ca-d7pvl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal","openshift-multus/multus-7x2qc","openshift-multus/multus-additional-cni-plugins-h667t","openshift-multus/network-metrics-daemon-2cx5t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl"] Oct 29 23:12:54.598147 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.598123 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.600239 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.600221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.602696 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.602447 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.602696 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.602520 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:12:54.605339 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.604713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.607616 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.607596 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.610545 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.610525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.612721 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.612704 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.614802 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.614781 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmxkp\"" Oct 29 23:12:54.615314 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.615296 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.615549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.615534 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.615947 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.615929 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 29 23:12:54.616070 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.616054 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.616425 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.616409 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 29 23:12:54.616611 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.616597 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c96z8\"" Oct 29 23:12:54.616705 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.616693 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.618223 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.618202 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:54.618455 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.618303 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:12:54.622374 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.622355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.624342 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.624321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.626594 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.626575 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:54.626682 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.626636 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:12:54.629036 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.628993 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.680562 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.680542 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 29 23:12:54.691083 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691058 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-sys-fs\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.691192 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-cnibin\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.691192 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691122 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.691331 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691211 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9fw\" (UniqueName: \"kubernetes.io/projected/d925d9a8-26ee-448e-bc33-007661c3414a-kube-api-access-lg9fw\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691331 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-systemd\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.691331 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691276 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wwf\" (UniqueName: \"kubernetes.io/projected/9107266c-733c-4bcd-8c8c-679ac2d5186f-kube-api-access-m4wwf\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.691488 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-netns\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691488 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691352 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-node-log\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691488 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-cni-binary-copy\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691488 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-conf-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691488 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691461 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-multus-daemon-config\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-run\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.691733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-log-socket\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691647 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-script-lib\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-multus-certs\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691733 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-modprobe-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysconfig\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jj2n\" (UniqueName: \"kubernetes.io/projected/79bb54aa-20a3-4a69-8215-26b2f006e219-kube-api-access-9jj2n\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-kubelet\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-system-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-cnibin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-kubelet-config\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.691944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3696b0b9-b3d7-479f-be52-853834548a9a-agent-certs\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691948 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-slash\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.691982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4z6s\" (UniqueName: \"kubernetes.io/projected/80f71f2d-d8d2-4097-a190-b52b04d11212-kube-api-access-z4z6s\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692000 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-device-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692045 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692069 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-socket-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692089 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-registration-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb54aa-20a3-4a69-8215-26b2f006e219-host-slash\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.692156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-config\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3aa46c84-d4da-4894-83f5-bfe0bb886c42-serviceca\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb54aa-20a3-4a69-8215-26b2f006e219-iptables-alerter-script\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-netd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-env-overrides\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-system-cni-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692340 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-kubelet\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa46c84-d4da-4894-83f5-bfe0bb886c42-host\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655998f3-b29e-47f0-9d86-04af9ff2d347-tmp-dir\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.692422 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-k8s-cni-cncf-io\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692439 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-hostroot\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692490 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-lib-modules\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-host\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-netns\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-bin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t42k\" (UniqueName: \"kubernetes.io/projected/3aa46c84-d4da-4894-83f5-bfe0bb886c42-kube-api-access-8t42k\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-tuned\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-tmp\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-ovn\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq27d\" (UniqueName: \"kubernetes.io/projected/bbbddaea-9907-436b-9b3f-110cdb69f8ee-kube-api-access-fq27d\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/655998f3-b29e-47f0-9d86-04af9ff2d347-hosts-file\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.692714 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssrns\" (UniqueName: \"kubernetes.io/projected/655998f3-b29e-47f0-9d86-04af9ff2d347-kube-api-access-ssrns\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpxwh\" (UniqueName: \"kubernetes.io/projected/86ad50c1-15f0-4411-ad5e-5462a40601e7-kube-api-access-fpxwh\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-multus\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-etc-kubernetes\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-conf\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-sys\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-systemd-units\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-systemd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-socket-dir-parent\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.692999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-var-lib-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-bin\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-kubernetes\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.693084 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-var-lib-kubelet\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.693667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-dbus\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.693667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3696b0b9-b3d7-479f-be52-853834548a9a-konnectivity-ca\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.693667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvspl\" (UniqueName: \"kubernetes.io/projected/2ca48acc-d5eb-434b-b8a3-e77928817c78-kube-api-access-dvspl\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.693667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693126 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-binary-copy\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.693667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-etc-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.693667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.693169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.705090 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.705047 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" event={"ID":"cb762aa62d1c58eba273642f34f2f74a","Type":"ContainerStarted","Data":"77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3"} Oct 29 23:12:54.706221 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.706202 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"8ca642e2900464b7ec6ed2498b328dcb","Type":"ContainerStarted","Data":"cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477"} Oct 29 23:12:54.716151 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716130 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 29 23:12:54.716245 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716215 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.716647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716577 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.716647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716629 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.716768 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716757 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.716821 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716779 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 29 23:12:54.716863 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.716782 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 29 23:12:54.717043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717025 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.717101 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717062 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.717268 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717251 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.717445 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717426 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.717504 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717490 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 29 23:12:54.717606 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717587 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 29 23:12:54.717710 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717673 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 29 23:12:54.717768 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717725 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 29 23:12:54.717768 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717762 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 29 23:12:54.717956 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.717940 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 29 23:12:54.718197 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.718184 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 29 23:12:54.719214 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.719196 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 29 23:12:54.727191 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.727170 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 29 23:12:54.728039 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.728022 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nnrj\"" Oct 29 23:12:54.729624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729554 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcbr2\"" Oct 29 23:12:54.729624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729575 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 29 23:12:54.729624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729586 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27bdq\"" Oct 29 23:12:54.729624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729578 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kxr2\"" Oct 29 23:12:54.729852 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729682 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lj8k\"" Oct 29 23:12:54.729852 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729733 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4s2ql\"" Oct 29 23:12:54.729852 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729741 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t5hzf\"" Oct 29 23:12:54.729852 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729785 2580 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 29 23:12:54.729852 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.729845 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zh5gt" Oct 29 23:12:54.794019 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.793992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.794141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9fw\" (UniqueName: \"kubernetes.io/projected/d925d9a8-26ee-448e-bc33-007661c3414a-kube-api-access-lg9fw\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-systemd\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.794141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wwf\" (UniqueName: \"kubernetes.io/projected/9107266c-733c-4bcd-8c8c-679ac2d5186f-kube-api-access-m4wwf\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.794141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-netns\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-node-log\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794152 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-cni-binary-copy\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-conf-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-multus-daemon-config\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-run\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-log-socket\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-script-lib\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-multus-certs\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-modprobe-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.794421 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysconfig\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jj2n\" (UniqueName: \"kubernetes.io/projected/79bb54aa-20a3-4a69-8215-26b2f006e219-kube-api-access-9jj2n\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-kubelet\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794506 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-system-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-cnibin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-kubelet-config\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3696b0b9-b3d7-479f-be52-853834548a9a-agent-certs\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-slash\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4z6s\" (UniqueName: \"kubernetes.io/projected/80f71f2d-d8d2-4097-a190-b52b04d11212-kube-api-access-z4z6s\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-device-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-socket-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-registration-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb54aa-20a3-4a69-8215-26b2f006e219-host-slash\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-config\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.794871 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3aa46c84-d4da-4894-83f5-bfe0bb886c42-serviceca\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb54aa-20a3-4a69-8215-26b2f006e219-iptables-alerter-script\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-netd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-env-overrides\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-system-cni-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-systemd\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-kubelet\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa46c84-d4da-4894-83f5-bfe0bb886c42-host\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655998f3-b29e-47f0-9d86-04af9ff2d347-tmp-dir\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-k8s-cni-cncf-io\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-hostroot\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795190 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-lib-modules\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-host\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.795647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795263 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-netns\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.796401 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-bin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.796401 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795370 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-bin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.796401 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t42k\" (UniqueName: \"kubernetes.io/projected/3aa46c84-d4da-4894-83f5-bfe0bb886c42-kube-api-access-8t42k\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.796401 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795564 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-node-log\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.796401 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795578 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-run\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.796401 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.796384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-tuned\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.796657 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.796428 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-modprobe-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.796839 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795129 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-netns\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797040 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797018 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797134 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797116 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.797197 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797176 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb54aa-20a3-4a69-8215-26b2f006e219-host-slash\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.797244 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797209 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-k8s-cni-cncf-io\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.797244 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-netd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797359 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.794780 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-multus-certs\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.797417 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797359 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797501 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797482 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-hostroot\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.797608 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.797589 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:54.797695 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797671 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-env-overrides\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797750 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.797707 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:55.297668908 +0000 UTC m=+3.120997717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:54.797750 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797738 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-config\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797827 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797776 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-system-cni-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.797827 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797793 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-slash\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.797889 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797839 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa46c84-d4da-4894-83f5-bfe0bb886c42-host\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.797957 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.797931 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.798024 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798008 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-device-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.798098 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798065 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655998f3-b29e-47f0-9d86-04af9ff2d347-tmp-dir\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.798156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798062 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-cnibin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.798156 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798135 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-kubelet-config\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.798460 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798438 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.798568 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798548 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-netns\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.798624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-tmp\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.798676 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798636 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-lib-modules\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.798676 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798648 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-ovn\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.798773 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq27d\" (UniqueName: \"kubernetes.io/projected/bbbddaea-9907-436b-9b3f-110cdb69f8ee-kube-api-access-fq27d\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:54.798773 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798698 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-registration-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.798773 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/655998f3-b29e-47f0-9d86-04af9ff2d347-hosts-file\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.798773 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssrns\" (UniqueName: \"kubernetes.io/projected/655998f3-b29e-47f0-9d86-04af9ff2d347-kube-api-access-ssrns\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.798773 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpxwh\" (UniqueName: \"kubernetes.io/projected/86ad50c1-15f0-4411-ad5e-5462a40601e7-kube-api-access-fpxwh\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.798924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-multus\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.798924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-etc-kubernetes\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.798924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:54.798924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-conf\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.798924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-sys\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.798924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.799171 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.798924 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-host\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.799325 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799305 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3aa46c84-d4da-4894-83f5-bfe0bb886c42-serviceca\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.799441 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.799424 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:54.799501 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.799496 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:12:55.29948046 +0000 UTC m=+3.122809257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:54.799549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799517 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-conf\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.799549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799517 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-multus-daemon-config\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.799549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799542 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-multus\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.799636 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799564 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-sys\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.799636 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799599 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-etc-kubernetes\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.799636 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799622 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-system-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.799719 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799670 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-log-socket\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.799749 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799736 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/655998f3-b29e-47f0-9d86-04af9ff2d347-hosts-file\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.799794 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799778 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-kubelet\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.799943 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799917 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.800005 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799975 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-ovn\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800005 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.799985 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysconfig\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.800111 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800093 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.800165 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800147 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-kubelet\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800213 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-systemd-units\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800253 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-systemd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800253 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-cni-binary-copy\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.800355 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800303 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-systemd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800355 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.800355 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800345 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-systemd-units\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.800549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.795577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-conf-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.800549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.800549 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800534 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-socket-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-socket-dir-parent\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800601 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-socket-dir-parent\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-var-lib-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800655 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800658 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-var-lib-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-bin\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.800724 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-kubernetes\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-bin\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800756 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-kubernetes\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800813 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-var-lib-kubelet\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-var-lib-kubelet\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-dbus\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800902 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3696b0b9-b3d7-479f-be52-853834548a9a-konnectivity-ca\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvspl\" (UniqueName: \"kubernetes.io/projected/2ca48acc-d5eb-434b-b8a3-e77928817c78-kube-api-access-dvspl\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800977 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-dbus\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.800993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-binary-copy\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.801043 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-etc-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.801476 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801070 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.801476 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-sys-fs\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.801476 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-cnibin\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.801476 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801214 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-cnibin\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.801669 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801509 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-script-lib\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.801669 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801530 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb54aa-20a3-4a69-8215-26b2f006e219-iptables-alerter-script\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.801669 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801592 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-etc-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.801669 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801600 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-sys-fs\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.801849 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801714 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-binary-copy\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.801978 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.801933 2580 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 29 23:12:54.802072 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.802042 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3696b0b9-b3d7-479f-be52-853834548a9a-konnectivity-ca\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.802744 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.802724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.806235 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.806167 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-tuned\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.806235 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.806191 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-tmp\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.806400 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.806300 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3696b0b9-b3d7-479f-be52-853834548a9a-agent-certs\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.806513 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.806492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.818126 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.818102 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wwf\" (UniqueName: \"kubernetes.io/projected/9107266c-733c-4bcd-8c8c-679ac2d5186f-kube-api-access-m4wwf\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.820990 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.820966 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9fw\" (UniqueName: \"kubernetes.io/projected/d925d9a8-26ee-448e-bc33-007661c3414a-kube-api-access-lg9fw\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.823430 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.823412 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:54.823528 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.823437 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:54.823528 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.823451 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:54.823528 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:54.823527 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:55.323509392 +0000 UTC m=+3.146838194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:54.826957 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.826883 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvspl\" (UniqueName: \"kubernetes.io/projected/2ca48acc-d5eb-434b-b8a3-e77928817c78-kube-api-access-dvspl\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.828720 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.828695 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssrns\" (UniqueName: \"kubernetes.io/projected/655998f3-b29e-47f0-9d86-04af9ff2d347-kube-api-access-ssrns\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.828820 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.828733 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t42k\" (UniqueName: \"kubernetes.io/projected/3aa46c84-d4da-4894-83f5-bfe0bb886c42-kube-api-access-8t42k\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.828820 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.828754 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4z6s\" (UniqueName: \"kubernetes.io/projected/80f71f2d-d8d2-4097-a190-b52b04d11212-kube-api-access-z4z6s\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.828820 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.828805 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jj2n\" (UniqueName: \"kubernetes.io/projected/79bb54aa-20a3-4a69-8215-26b2f006e219-kube-api-access-9jj2n\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.829429 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.829389 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq27d\" (UniqueName: \"kubernetes.io/projected/bbbddaea-9907-436b-9b3f-110cdb69f8ee-kube-api-access-fq27d\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:54.830691 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.830668 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpxwh\" (UniqueName: \"kubernetes.io/projected/86ad50c1-15f0-4411-ad5e-5462a40601e7-kube-api-access-fpxwh\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.911668 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.911643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:12:54.923204 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.923187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7x2qc" Oct 29 23:12:54.931383 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.931365 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:12:54.942026 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.942005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:12:54.942936 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.942911 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ad50c1_15f0_4411_ad5e_5462a40601e7.slice/crio-b20719b60707aa037b0e7efd446e16bb4640cde6829586c0f4b50795bdb580df WatchSource:0}: Error finding container b20719b60707aa037b0e7efd446e16bb4640cde6829586c0f4b50795bdb580df: Status 404 returned error can't find the container with id b20719b60707aa037b0e7efd446e16bb4640cde6829586c0f4b50795bdb580df Oct 29 23:12:54.945823 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.945808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:12:54.945960 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.945891 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3696b0b9_b3d7_479f_be52_853834548a9a.slice/crio-791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2 WatchSource:0}: Error finding container 791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2: Status 404 returned error can't find the container with id 791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2 Oct 29 23:12:54.946583 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.946482 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd925d9a8_26ee_448e_bc33_007661c3414a.slice/crio-7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d WatchSource:0}: Error finding container 7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d: Status 404 returned error can't find the container with id 7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d Oct 29 23:12:54.953751 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.953732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:12:54.956415 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.956381 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9107266c_733c_4bcd_8c8c_679ac2d5186f.slice/crio-7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba WatchSource:0}: Error finding container 7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba: Status 404 returned error can't find the container with id 7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba Oct 29 23:12:54.960018 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.959997 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bb54aa_20a3_4a69_8215_26b2f006e219.slice/crio-220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd WatchSource:0}: Error finding container 220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd: Status 404 returned error can't find the container with id 220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd Oct 29 23:12:54.966964 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.966947 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa46c84_d4da_4894_83f5_bfe0bb886c42.slice/crio-508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894 WatchSource:0}: Error finding container 508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894: Status 404 returned error can't find the container with id 508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894 Oct 29 23:12:54.973942 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.973921 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4qzft" Oct 29 23:12:54.980984 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.980963 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:12:54.989768 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:54.989747 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca48acc_d5eb_434b_b8a3_e77928817c78.slice/crio-abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2 WatchSource:0}: Error finding container abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2: Status 404 returned error can't find the container with id abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2 Oct 29 23:12:54.992382 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.992364 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:12:54.997553 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:54.997535 2580 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:12:55.002751 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:12:55.002727 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80f71f2d_d8d2_4097_a190_b52b04d11212.slice/crio-987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a WatchSource:0}: Error finding container 987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a: Status 404 returned error can't find the container with id 987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a Oct 29 23:12:55.305436 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.305407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:55.305548 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.305467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:55.305799 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.305603 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:55.305799 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.305678 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:56.305654112 +0000 UTC m=+4.128982898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:55.305799 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.305697 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:55.305799 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.305775 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:12:56.305755524 +0000 UTC m=+4.129084322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:55.406454 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.406382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:55.406590 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.406572 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:55.406649 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.406591 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:55.406649 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.406604 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:55.406743 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.406657 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:56.406639597 +0000 UTC m=+4.229968395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:55.701681 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.701397 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:55.701681 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:55.701573 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:12:55.732745 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.732688 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:54 +0000 UTC" deadline="2028-06-22 22:31:53.575731779 +0000 UTC" Oct 29 23:12:55.732745 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.732744 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14447h18m57.842991658s" Oct 29 23:12:55.743356 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.743325 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdkfv" event={"ID":"3696b0b9-b3d7-479f-be52-853834548a9a","Type":"ContainerStarted","Data":"791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2"} Oct 29 23:12:55.747956 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.747926 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerStarted","Data":"987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a"} Oct 29 23:12:55.760309 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.757468 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2"} Oct 29 23:12:55.763863 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.763838 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qzft" event={"ID":"655998f3-b29e-47f0-9d86-04af9ff2d347","Type":"ContainerStarted","Data":"a0f3839c516d560a61fab5f45c5cbeb741ccb57c2b1709a7a9a596361d15440f"} Oct 29 23:12:55.780808 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.780782 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7pvl" event={"ID":"3aa46c84-d4da-4894-83f5-bfe0bb886c42","Type":"ContainerStarted","Data":"508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894"} Oct 29 23:12:55.789500 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.789474 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" event={"ID":"9107266c-733c-4bcd-8c8c-679ac2d5186f","Type":"ContainerStarted","Data":"7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba"} Oct 29 23:12:55.799482 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.799444 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7x2qc" event={"ID":"d925d9a8-26ee-448e-bc33-007661c3414a","Type":"ContainerStarted","Data":"7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d"} Oct 29 23:12:55.809470 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.809448 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" event={"ID":"86ad50c1-15f0-4411-ad5e-5462a40601e7","Type":"ContainerStarted","Data":"b20719b60707aa037b0e7efd446e16bb4640cde6829586c0f4b50795bdb580df"} Oct 29 23:12:55.818958 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.818934 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" event={"ID":"cb762aa62d1c58eba273642f34f2f74a","Type":"ContainerStarted","Data":"418148f7bf3425bc30f6071b2a45777ee4dcc517a92d005c9bac9371f1fe9314"} Oct 29 23:12:55.820855 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.820805 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ca642e2900464b7ec6ed2498b328dcb" containerID="0ebebd41296a1e0e2eeb068c9508aa40d8c5857fe88844cd472e3175249566ef" exitCode=0 Oct 29 23:12:55.820855 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.820845 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"8ca642e2900464b7ec6ed2498b328dcb","Type":"ContainerDied","Data":"0ebebd41296a1e0e2eeb068c9508aa40d8c5857fe88844cd472e3175249566ef"} Oct 29 23:12:55.825357 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.825332 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghx8k" event={"ID":"79bb54aa-20a3-4a69-8215-26b2f006e219","Type":"ContainerStarted","Data":"220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd"} Oct 29 23:12:55.858220 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:55.858172 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" podStartSLOduration=1.858156589 podStartE2EDuration="1.858156589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:55.857512635 +0000 UTC m=+3.680841442" watchObservedRunningTime="2026-10-29 23:12:55.858156589 +0000 UTC m=+3.681485398" Oct 29 23:12:56.312692 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.312408 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:56.312840 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.312703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:56.312840 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.312564 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:56.312840 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.312780 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.312758864 +0000 UTC m=+6.136087667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:56.312840 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.312818 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:56.313063 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.312869 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.312852816 +0000 UTC m=+6.136181614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:56.413187 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.413155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:56.413776 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.413756 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:56.413870 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.413780 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:56.413870 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.413793 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:56.413870 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.413856 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.413837148 +0000 UTC m=+6.237165948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:56.704462 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.701648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:56.704462 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.701772 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:12:56.704462 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.701875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:56.704462 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:56.701969 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:12:56.732899 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.732864 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:54 +0000 UTC" deadline="2028-05-04 10:12:24.497620842 +0000 UTC" Oct 29 23:12:56.732899 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.732899 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13258h59m27.764726471s" Oct 29 23:12:56.850503 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.850471 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"8ca642e2900464b7ec6ed2498b328dcb","Type":"ContainerStarted","Data":"c67e0f166d22711404e372d6fa79fc86d65158abd18a925e00f606dd805c0007"} Oct 29 23:12:56.891337 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:56.891269 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" podStartSLOduration=2.891251113 podStartE2EDuration="2.891251113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:56.890898163 +0000 UTC m=+4.714226973" watchObservedRunningTime="2026-10-29 23:12:56.891251113 +0000 UTC m=+4.714579923" Oct 29 23:12:57.701673 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:57.701640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:57.701866 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:57.701777 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:12:57.867532 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:57.867495 2580 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="837e906eab4ff6e8623229a6af7d836e0ce38a4b25e76e01702c516b99ee7a2d" exitCode=0 Oct 29 23:12:57.868505 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:57.868479 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerDied","Data":"837e906eab4ff6e8623229a6af7d836e0ce38a4b25e76e01702c516b99ee7a2d"} Oct 29 23:12:58.328267 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:58.327525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:58.328267 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:58.327607 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:58.328267 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.327729 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:58.328267 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.327789 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:13:02.327768817 +0000 UTC m=+10.151097620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:12:58.328267 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.328185 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:58.328267 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.328231 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:02.328216469 +0000 UTC m=+10.151545256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:12:58.428148 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:58.428107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:58.428376 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.428360 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:12:58.428453 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.428380 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:12:58.428453 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.428392 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:58.428453 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.428451 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:13:02.42843291 +0000 UTC m=+10.251761710 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:12:58.702454 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:58.702418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:12:58.702454 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:58.702455 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:12:58.702689 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.702575 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:12:58.702747 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:58.702727 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:12:59.701648 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:59.701614 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:12:59.702125 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:12:59.701749 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:12:59.881095 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:12:59.881058 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdkfv" event={"ID":"3696b0b9-b3d7-479f-be52-853834548a9a","Type":"ContainerStarted","Data":"e223dd6c622ca97db6b2d0abb8c99a4fe6ef6ee2aefbe7cb07b4dd296195e4b5"} Oct 29 23:13:00.701861 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:00.701354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:00.701861 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:00.701439 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:00.701861 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:00.701691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:00.701861 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:00.701773 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:00.885694 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:00.885064 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7pvl" event={"ID":"3aa46c84-d4da-4894-83f5-bfe0bb886c42","Type":"ContainerStarted","Data":"f17b2272836f0c4d685050d54cee10b2b5479c7a0c18bb93308256ce268fc8bd"} Oct 29 23:13:00.888683 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:00.888617 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" event={"ID":"9107266c-733c-4bcd-8c8c-679ac2d5186f","Type":"ContainerStarted","Data":"139eab15e77ea680409e89f27c61b3d12f3436f5a7b88a8657d91dc5db2363ff"} Oct 29 23:13:00.925179 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:00.924745 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdkfv" podStartSLOduration=5.074778317 podStartE2EDuration="8.92472822s" totalImagesPullingTime="3.849949903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:59.920211139 +0000 UTC m=+7.743539948" watchObservedRunningTime="2026-10-29 23:13:00.92472822 +0000 UTC m=+8.748057028" Oct 29 23:13:00.925179 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:00.925053 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d7pvl" podStartSLOduration=4.090709939 podStartE2EDuration="8.925046322s" totalImagesPullingTime="4.834336383s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:00.924458182 +0000 UTC m=+8.747786991" watchObservedRunningTime="2026-10-29 23:13:00.925046322 +0000 UTC m=+8.748375131" Oct 29 23:13:01.701255 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:01.701220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:01.701435 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:01.701373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:02.099667 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.099607 2580 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 29 23:13:02.362089 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.362053 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:02.362219 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.362135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:02.362298 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.362274 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:02.362365 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.362344 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.362326036 +0000 UTC m=+18.185654834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:02.362434 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.362402 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:02.362434 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.362433 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.362422367 +0000 UTC m=+18.185751165 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:02.462831 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.462577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:02.462831 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.462717 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:13:02.462831 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.462734 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:13:02.462831 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.462742 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:02.462831 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.462780 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.46276631 +0000 UTC m=+18.286095106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:02.649122 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.649007 2580 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:13:02.099632299Z","UUID":"9eb86892-b4eb-418a-a932-eae9b633725a","Handler":null,"Name":"","Endpoint":""} Oct 29 23:13:02.651693 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.651667 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 29 23:13:02.651824 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.651700 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 29 23:13:02.703455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.703433 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:02.703525 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.703442 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:02.703569 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.703554 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:02.703641 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:02.703623 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:02.897012 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.896986 2580 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="9f161a22783bed13586dc07c2529eb2fe8e3b3d17c40b14972161ebf3aed4a69" exitCode=0 Oct 29 23:13:02.897165 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.897083 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerDied","Data":"9f161a22783bed13586dc07c2529eb2fe8e3b3d17c40b14972161ebf3aed4a69"} Oct 29 23:13:02.899516 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.899244 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4qzft" event={"ID":"655998f3-b29e-47f0-9d86-04af9ff2d347","Type":"ContainerStarted","Data":"bbcba864ebbafa2a760489da73b9dc9891675a80ccd17cf80454634abb2afbeb"} Oct 29 23:13:02.902990 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.902966 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" event={"ID":"9107266c-733c-4bcd-8c8c-679ac2d5186f","Type":"ContainerStarted","Data":"55af52c525cebd323556aea7d8b64c10943734420ac014e5233df9926b035165"} Oct 29 23:13:02.904856 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.904828 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7x2qc" event={"ID":"d925d9a8-26ee-448e-bc33-007661c3414a","Type":"ContainerStarted","Data":"f53a4766ea634f16a48d6b97b4c8f7479877c6f0aaf52f994c68ad7846f6e038"} Oct 29 23:13:02.982802 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:02.982743 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-4qzft" podStartSLOduration=3.274705657 podStartE2EDuration="10.982731439s" totalImagesPullingTime="7.708025782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:02.982405751 +0000 UTC m=+10.805734558" watchObservedRunningTime="2026-10-29 23:13:02.982731439 +0000 UTC m=+10.806060245" Oct 29 23:13:03.023618 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.023218 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-7x2qc" podStartSLOduration=3.604584907 podStartE2EDuration="11.023203874s" totalImagesPullingTime="7.418618967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:03.022583616 +0000 UTC m=+10.845912424" watchObservedRunningTime="2026-10-29 23:13:03.023203874 +0000 UTC m=+10.846532677" Oct 29 23:13:03.316375 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.316342 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:13:03.316928 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.316899 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:13:03.701614 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.701586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:03.701737 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:03.701711 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:03.909948 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.909908 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" event={"ID":"9107266c-733c-4bcd-8c8c-679ac2d5186f","Type":"ContainerStarted","Data":"bb96ccde1f08896a7828616481c40369a6f52326246b8a44013566e8c9c8185c"} Oct 29 23:13:03.913189 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.913160 2580 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="fd75ad1e3fc092aaad68703adb0c5b7098f70d101b9d8ea5ed3bf24ac034834d" exitCode=0 Oct 29 23:13:03.913962 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.913940 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerDied","Data":"fd75ad1e3fc092aaad68703adb0c5b7098f70d101b9d8ea5ed3bf24ac034834d"} Oct 29 23:13:03.959642 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:03.959592 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" podStartSLOduration=4.173251405 podStartE2EDuration="11.959574628s" totalImagesPullingTime="7.786323223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:03.958801038 +0000 UTC m=+11.782129855" watchObservedRunningTime="2026-10-29 23:13:03.959574628 +0000 UTC m=+11.782903439" Oct 29 23:13:04.701569 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:04.701421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:04.701569 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:04.701471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:04.701874 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:04.701576 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:04.701874 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:04.701705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:04.917610 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:04.917574 2580 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="89464ede479447677f1d37f8200d95851affd33cbdc2f4a071510b51621e4daa" exitCode=0 Oct 29 23:13:04.917781 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:04.917667 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerDied","Data":"89464ede479447677f1d37f8200d95851affd33cbdc2f4a071510b51621e4daa"} Oct 29 23:13:04.920257 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:04.919858 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" event={"ID":"86ad50c1-15f0-4411-ad5e-5462a40601e7","Type":"ContainerStarted","Data":"38b11a63d3fc9801bb99958fd9156a7d7a2b4373aeba039aca03dccb96a97c7c"} Oct 29 23:13:04.921645 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:04.921621 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ghx8k" event={"ID":"79bb54aa-20a3-4a69-8215-26b2f006e219","Type":"ContainerStarted","Data":"9767f384c859d6cad0daca03020de5223192d17cc56fd6e22a2e2b738fe15cd1"} Oct 29 23:13:05.068649 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:05.068561 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ghx8k" podStartSLOduration=5.11589454 podStartE2EDuration="13.068544375s" totalImagesPullingTime="7.952649835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:05.067979315 +0000 UTC m=+12.891308123" watchObservedRunningTime="2026-10-29 23:13:05.068544375 +0000 UTC m=+12.891873183" Oct 29 23:13:05.068649 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:05.068640 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" podStartSLOduration=3.362519486 podStartE2EDuration="13.068636154s" totalImagesPullingTime="9.706116668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:05.028816793 +0000 UTC m=+12.852145601" watchObservedRunningTime="2026-10-29 23:13:05.068636154 +0000 UTC m=+12.891964960" Oct 29 23:13:05.701892 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:05.701865 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:05.702517 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:05.701964 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:06.294162 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:06.294127 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qzft_655998f3-b29e-47f0-9d86-04af9ff2d347/dns-node-resolver/0.log" Oct 29 23:13:06.701952 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:06.701928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:06.702524 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:06.702060 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:06.702584 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:06.702561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:06.702695 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:06.702671 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:06.929503 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:06.929473 2580 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="faf58072d348eb6c3ae33f3c467d111b7160de821e9622165b83bf40aef46d86" exitCode=0 Oct 29 23:13:06.929665 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:06.929521 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerDied","Data":"faf58072d348eb6c3ae33f3c467d111b7160de821e9622165b83bf40aef46d86"} Oct 29 23:13:07.438902 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:07.438870 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7pvl_3aa46c84-d4da-4894-83f5-bfe0bb886c42/node-ca/0.log" Oct 29 23:13:07.701079 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:07.701003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:07.701223 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:07.701128 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:07.935519 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:07.935486 2580 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="c139543cd9d53ba08b806d9b09c24acec64d227f57b6be6ba035783c96d54494" exitCode=0 Oct 29 23:13:07.936079 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:07.935534 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerDied","Data":"c139543cd9d53ba08b806d9b09c24acec64d227f57b6be6ba035783c96d54494"} Oct 29 23:13:08.704539 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:08.704377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:08.704701 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:08.704434 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:08.704701 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:08.704603 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:08.704701 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:08.704680 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:08.939983 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:08.939960 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h667t" event={"ID":"80f71f2d-d8d2-4097-a190-b52b04d11212","Type":"ContainerStarted","Data":"38ac8a9c57ca224d71e9fc739c9ba4a62fa6aa6db348d288dfd5fb2715f28890"} Oct 29 23:13:08.985693 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:08.985631 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h667t" podStartSLOduration=7.096242964 podStartE2EDuration="16.985619546s" totalImagesPullingTime="9.889376582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:08.985385618 +0000 UTC m=+16.808714423" watchObservedRunningTime="2026-10-29 23:13:08.985619546 +0000 UTC m=+16.808948352" Oct 29 23:13:09.701705 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.701674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:09.701868 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:09.701787 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:09.945228 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945205 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:13:09.945579 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945546 2580 generic.go:356] "Generic (PLEG): container finished" podID="2ca48acc-d5eb-434b-b8a3-e77928817c78" containerID="47985fa9dde12173334be3d4f219eb73bd79cc772ed55634ba775678bb16d5f2" exitCode=1 Oct 29 23:13:09.945639 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945617 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"1d77e39e0bda3c66bfc2b491c5511a835ef69073dd980fda4e94c87e4d2384fd"} Oct 29 23:13:09.945693 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945681 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"e69f6a5bcee1633a0e16dbe04b61051d66e1d10041fe57935cdab4889b5eef42"} Oct 29 23:13:09.945735 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945715 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"4244134b5a6ea425a147fc2535bda9cda9d3c29ad47a0a9e6b406da01ccd0161"} Oct 29 23:13:09.945765 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945743 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"c83e01081e7da13164f53b9f2047bc326e6cd807fb147741dea5add2900916e2"} Oct 29 23:13:09.945799 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945772 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerDied","Data":"47985fa9dde12173334be3d4f219eb73bd79cc772ed55634ba775678bb16d5f2"} Oct 29 23:13:09.945830 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:09.945804 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"641d0e536267b2e10d9f406b356104b64fe6a9747f819c202f26d494da91ae9d"} Oct 29 23:13:10.424096 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:10.424066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:10.424238 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:10.424116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:10.424238 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.424208 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:10.424324 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.424263 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:13:26.42424471 +0000 UTC m=+34.247573498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:10.424324 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.424208 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:10.424388 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.424342 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:26.424329513 +0000 UTC m=+34.247658331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:10.525176 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:10.525146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:10.525341 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.525321 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:13:10.525405 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.525348 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:13:10.525405 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.525361 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:10.525495 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.525421 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:13:26.525403015 +0000 UTC m=+34.348731798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:10.701759 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:10.701699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:10.701856 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.701833 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:10.701907 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:10.701886 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:10.702003 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:10.701985 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:11.701539 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:11.701464 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:11.701869 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:11.701570 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:11.952713 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:11.952646 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:13:11.953032 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:11.953010 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"41937a4cab90748f521ca9c53fdefaecca62549d9fe85b32c3c3a08d956ef860"} Oct 29 23:13:12.199912 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:12.199885 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:13:12.200028 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:12.199980 2580 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:13:12.200485 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:12.200461 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:13:12.701685 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:12.701652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:12.702129 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:12.701749 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:12.702129 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:12.701857 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:12.702129 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:12.701969 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:13.701012 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.700983 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:13.701142 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:13.701086 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:13.960011 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.959985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:13:13.960654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.960324 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"c8b4dea7f7603671bc7f430cea6fe34b5d90f2b66d3a3d7f5284545fa4849202"} Oct 29 23:13:13.960654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.960559 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:13:13.960654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.960625 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:13:13.960811 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.960717 2580 scope.go:122] "RemoveContainer" containerID="47985fa9dde12173334be3d4f219eb73bd79cc772ed55634ba775678bb16d5f2" Oct 29 23:13:13.976934 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:13.976917 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:13:14.701781 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:14.701546 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:14.701924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:14.701565 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:14.701924 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:14.701882 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:14.702038 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:14.701945 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:14.965264 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:14.965195 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:13:14.965658 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:14.965571 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" event={"ID":"2ca48acc-d5eb-434b-b8a3-e77928817c78","Type":"ContainerStarted","Data":"ed2e63e0b39a2eae133160577bd13e05eea620e09863b5bcb9329414681a54f3"} Oct 29 23:13:14.965827 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:14.965807 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:13:14.980368 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:14.980347 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:13:15.034332 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:15.034266 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" podStartSLOduration=9.115113413 podStartE2EDuration="23.034254891s" totalImagesPullingTime="13.919141478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:15.032018678 +0000 UTC m=+22.855347483" watchObservedRunningTime="2026-10-29 23:13:15.034254891 +0000 UTC m=+22.857583744" Oct 29 23:13:15.701346 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:15.701317 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:15.701483 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:15.701412 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:16.701568 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:16.701533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:16.702103 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:16.701664 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:16.702103 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:16.701707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:16.702103 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:16.701790 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:17.701573 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:17.701546 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:17.701910 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:17.701634 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:18.703888 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:18.703860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:18.703888 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:18.703890 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:18.704266 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:18.703963 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:18.704266 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:18.704005 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:19.701108 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:19.701078 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:19.701362 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:19.701168 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:20.703866 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:20.703830 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:20.704370 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:20.703944 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:20.704370 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:20.703986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:20.704370 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:20.704080 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:21.701713 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:21.701685 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:21.701876 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:21.701799 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:22.701997 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:22.701971 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:22.702475 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:22.702096 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:22.702475 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:22.702158 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:22.702475 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:22.702264 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:23.701196 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:23.701169 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:23.701358 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:23.701264 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:24.701978 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:24.701945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:24.702472 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:24.702076 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:24.702472 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:24.702148 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:24.702472 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:24.702232 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:25.701174 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:25.701142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:25.701380 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:25.701261 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:26.436229 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:26.436197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:26.436673 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:26.436244 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:26.436673 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.436354 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:26.436673 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.436355 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:26.436673 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.436406 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs podName:bbbddaea-9907-436b-9b3f-110cdb69f8ee nodeName:}" failed. No retries permitted until 2026-10-29 23:13:58.436390512 +0000 UTC m=+66.259719296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs") pod "network-metrics-daemon-2cx5t" (UID: "bbbddaea-9907-436b-9b3f-110cdb69f8ee") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 29 23:13:26.436673 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.436419 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret podName:f97e9991-dae4-4dfd-a57e-02842e3097f0 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:58.43641253 +0000 UTC m=+66.259741313 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret") pod "global-pull-secret-syncer-rrcsq" (UID: "f97e9991-dae4-4dfd-a57e-02842e3097f0") : object "kube-system"/"original-pull-secret" not registered Oct 29 23:13:26.536700 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:26.536671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:26.536877 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.536803 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 29 23:13:26.536877 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.536816 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 29 23:13:26.536877 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.536826 2580 projected.go:196] Error preparing data for projected volume kube-api-access-v9klr for pod openshift-network-diagnostics/network-check-target-xnstf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:26.536877 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.536869 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr podName:c8549705-e856-4420-9185-66dc04edac7e nodeName:}" failed. No retries permitted until 2026-10-29 23:13:58.536857589 +0000 UTC m=+66.360186386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v9klr" (UniqueName: "kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr") pod "network-check-target-xnstf" (UID: "c8549705-e856-4420-9185-66dc04edac7e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 29 23:13:26.703350 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:26.702106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:26.703350 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.702227 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:26.703350 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:26.702693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:26.703350 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:26.702792 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:27.667678 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:27.667641 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2cx5t"] Oct 29 23:13:27.668119 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:27.667771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:27.668119 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:27.667904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:27.671455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:27.670244 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rrcsq"] Oct 29 23:13:27.671455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:27.670314 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnstf"] Oct 29 23:13:27.671455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:27.670377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:27.671455 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:27.670452 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:27.671455 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:27.670491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:27.671455 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:27.670532 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:29.701766 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:29.701734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:29.701766 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:29.701763 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:29.702216 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:29.701765 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:29.702216 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:29.701867 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:29.702216 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:29.701921 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:29.702216 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:29.701964 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:31.701431 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:31.701399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:31.701431 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:31.701425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:31.701894 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:31.701514 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnstf" podUID="c8549705-e856-4420-9185-66dc04edac7e" Oct 29 23:13:31.701894 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:31.701564 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:31.701894 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:31.701668 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rrcsq" podUID="f97e9991-dae4-4dfd-a57e-02842e3097f0" Oct 29 23:13:31.701894 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:13:31.701710 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2cx5t" podUID="bbbddaea-9907-436b-9b3f-110cdb69f8ee" Oct 29 23:13:31.948624 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:31.948439 2580 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeReady" Oct 29 23:13:31.948768 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:31.948710 2580 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 29 23:13:32.004132 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.004071 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lzd9f"] Oct 29 23:13:32.040336 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.040316 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xbqbf"] Oct 29 23:13:32.040451 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.040432 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.043610 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.043583 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hsgvx"] Oct 29 23:13:32.043719 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.043691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.056048 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.056028 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 29 23:13:32.056149 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.056077 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 29 23:13:32.056149 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.056128 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 29 23:13:32.056243 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.056231 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h6cnq\"" Oct 29 23:13:32.058979 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.058963 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 29 23:13:32.059462 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.059447 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzd9f"] Oct 29 23:13:32.059516 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.059478 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xbqbf"] Oct 29 23:13:32.059516 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.059500 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsgvx"] Oct 29 23:13:32.059594 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.059582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.059808 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.059790 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 29 23:13:32.059926 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.059849 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 29 23:13:32.062418 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.062403 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crphw\"" Oct 29 23:13:32.062490 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.062454 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 29 23:13:32.074293 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.074262 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 29 23:13:32.074366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.074305 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-984bt\"" Oct 29 23:13:32.074477 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.074464 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 29 23:13:32.177763 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef2d1228-d6dd-4398-8c36-4be128ee0e62-crio-socket\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.177845 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2da3399e-5270-4bde-82e2-f9743a281797-cert\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.177845 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2d1228-d6dd-4398-8c36-4be128ee0e62-data-volume\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.177912 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s6cp\" (UniqueName: \"kubernetes.io/projected/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-api-access-8s6cp\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.177912 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgcdb\" (UniqueName: \"kubernetes.io/projected/f9017cbf-6684-4052-a42c-d48f05c21961-kube-api-access-lgcdb\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.177973 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef2d1228-d6dd-4398-8c36-4be128ee0e62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.178004 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.177980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9017cbf-6684-4052-a42c-d48f05c21961-metrics-tls\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.178035 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.178006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d2hp\" (UniqueName: \"kubernetes.io/projected/2da3399e-5270-4bde-82e2-f9743a281797-kube-api-access-7d2hp\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.178035 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.178023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9017cbf-6684-4052-a42c-d48f05c21961-config-volume\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.178094 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.178066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9017cbf-6684-4052-a42c-d48f05c21961-tmp-dir\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.178132 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.178120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.229253 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.229233 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qzft_655998f3-b29e-47f0-9d86-04af9ff2d347/dns-node-resolver/0.log" Oct 29 23:13:32.278492 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9017cbf-6684-4052-a42c-d48f05c21961-tmp-dir\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.278492 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.278618 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef2d1228-d6dd-4398-8c36-4be128ee0e62-crio-socket\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.278674 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2da3399e-5270-4bde-82e2-f9743a281797-cert\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.278718 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278680 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef2d1228-d6dd-4398-8c36-4be128ee0e62-crio-socket\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.278718 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2d1228-d6dd-4398-8c36-4be128ee0e62-data-volume\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.278787 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278716 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s6cp\" (UniqueName: \"kubernetes.io/projected/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-api-access-8s6cp\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.278787 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgcdb\" (UniqueName: \"kubernetes.io/projected/f9017cbf-6684-4052-a42c-d48f05c21961-kube-api-access-lgcdb\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.278787 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef2d1228-d6dd-4398-8c36-4be128ee0e62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.278945 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278830 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9017cbf-6684-4052-a42c-d48f05c21961-metrics-tls\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.278945 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.278856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2hp\" (UniqueName: \"kubernetes.io/projected/2da3399e-5270-4bde-82e2-f9743a281797-kube-api-access-7d2hp\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.279042 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.279028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9017cbf-6684-4052-a42c-d48f05c21961-tmp-dir\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.279093 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.279046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9017cbf-6684-4052-a42c-d48f05c21961-config-volume\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.279367 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.279340 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.279464 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.279349 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2d1228-d6dd-4398-8c36-4be128ee0e62-data-volume\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.279526 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.279507 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9017cbf-6684-4052-a42c-d48f05c21961-config-volume\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.282564 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.282542 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2da3399e-5270-4bde-82e2-f9743a281797-cert\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.282564 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.282550 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9017cbf-6684-4052-a42c-d48f05c21961-metrics-tls\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.282683 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.282551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef2d1228-d6dd-4398-8c36-4be128ee0e62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.298949 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.298930 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s6cp\" (UniqueName: \"kubernetes.io/projected/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-api-access-8s6cp\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.300670 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.299356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgcdb\" (UniqueName: \"kubernetes.io/projected/f9017cbf-6684-4052-a42c-d48f05c21961-kube-api-access-lgcdb\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.300670 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.299523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2hp\" (UniqueName: \"kubernetes.io/projected/2da3399e-5270-4bde-82e2-f9743a281797-kube-api-access-7d2hp\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.367589 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.367567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:13:32.433703 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.433672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:32.447801 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.447777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:13:32.733801 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.733778 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzd9f"] Oct 29 23:13:32.738055 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:32.738031 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da3399e_5270_4bde_82e2_f9743a281797.slice/crio-52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5 WatchSource:0}: Error finding container 52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5: Status 404 returned error can't find the container with id 52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5 Oct 29 23:13:32.753327 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.753303 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsgvx"] Oct 29 23:13:32.755802 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:32.755780 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9017cbf_6684_4052_a42c_d48f05c21961.slice/crio-b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328 WatchSource:0}: Error finding container b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328: Status 404 returned error can't find the container with id b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328 Oct 29 23:13:32.775787 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.775765 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xbqbf"] Oct 29 23:13:32.779734 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:32.779712 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2d1228_d6dd_4398_8c36_4be128ee0e62.slice/crio-0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba WatchSource:0}: Error finding container 0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba: Status 404 returned error can't find the container with id 0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba Oct 29 23:13:32.999987 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.999769 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbqbf" event={"ID":"ef2d1228-d6dd-4398-8c36-4be128ee0e62","Type":"ContainerStarted","Data":"b70a47418beb783f5f8350ada1ff10ed82b48de6f99dffe0f1af8f3e5df15c09"} Oct 29 23:13:32.999987 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:32.999970 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbqbf" event={"ID":"ef2d1228-d6dd-4398-8c36-4be128ee0e62","Type":"ContainerStarted","Data":"0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba"} Oct 29 23:13:33.000847 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.000827 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsgvx" event={"ID":"f9017cbf-6684-4052-a42c-d48f05c21961","Type":"ContainerStarted","Data":"b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328"} Oct 29 23:13:33.001781 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.001758 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzd9f" event={"ID":"2da3399e-5270-4bde-82e2-f9743a281797","Type":"ContainerStarted","Data":"52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5"} Oct 29 23:13:33.629592 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.629497 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7pvl_3aa46c84-d4da-4894-83f5-bfe0bb886c42/node-ca/0.log" Oct 29 23:13:33.701426 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.701376 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:33.701426 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.701411 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:33.701666 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.701584 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:33.716708 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.716655 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:33.717110 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.717091 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:33.729197 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.729175 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\"" Oct 29 23:13:33.729379 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.729363 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:33.729441 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.729382 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\"" Oct 29 23:13:33.729441 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.729401 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:33.729441 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.729402 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\"" Oct 29 23:13:33.784538 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.784510 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-797fcc75d7-bv46z"] Oct 29 23:13:33.806596 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.806574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.812790 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.812771 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797fcc75d7-bv46z"] Oct 29 23:13:33.823899 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.823878 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 29 23:13:33.824004 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.823879 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 29 23:13:33.824297 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.824173 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 29 23:13:33.824373 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.824324 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 29 23:13:33.824373 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.824362 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 29 23:13:33.824545 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.824381 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 29 23:13:33.824545 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.824415 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 29 23:13:33.824545 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.824474 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zvskk\"" Oct 29 23:13:33.891736 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.891666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.891736 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.891707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.891970 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.891843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.891970 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.891893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.891970 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.891944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.892154 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.891980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.892154 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.892013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993063 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993200 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993200 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993404 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993495 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993495 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993642 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993807 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993785 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.993962 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.994032 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.993969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.994153 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.994133 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.997497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.997473 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:33.997726 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:33.997702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:34.023794 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.023772 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:34.135443 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.135415 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:34.421449 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.421387 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp"] Oct 29 23:13:34.434395 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.434371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.447929 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.447903 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp"] Oct 29 23:13:34.450166 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.449730 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 29 23:13:34.450166 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.449808 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 29 23:13:34.450166 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.449826 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 29 23:13:34.450166 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.449958 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wsr6j\"" Oct 29 23:13:34.450166 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.450136 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 29 23:13:34.450166 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.450158 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 29 23:13:34.480122 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.479898 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797fcc75d7-bv46z"] Oct 29 23:13:34.484099 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:34.484072 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc9c65d_e9b4_477e_ba59_0a9001d9b2e8.slice/crio-5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6 WatchSource:0}: Error finding container 5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6: Status 404 returned error can't find the container with id 5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6 Oct 29 23:13:34.519229 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.519201 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j55lx"] Oct 29 23:13:34.533961 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.533301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.551584 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.551548 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 29 23:13:34.551980 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.551945 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 29 23:13:34.552062 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.552012 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6s7px\"" Oct 29 23:13:34.552257 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.552229 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 29 23:13:34.598580 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.598548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.598734 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.598606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.598786 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.598748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j5db\" (UniqueName: \"kubernetes.io/projected/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-kube-api-access-5j5db\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.598826 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.598799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.699808 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.699737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-sys\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.699808 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.699783 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-metrics-client-ca\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.699993 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.699813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgxsn\" (UniqueName: \"kubernetes.io/projected/270efdc7-7967-4f7d-b4f6-b37bc80716e8-kube-api-access-fgxsn\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.699993 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.699899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.700416 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.700557 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-textfile\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.700557 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-wtmp\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.700659 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-tls\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.700659 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700620 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.700757 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-root\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.700810 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5db\" (UniqueName: \"kubernetes.io/projected/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-kube-api-access-5j5db\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.700810 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.700907 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.700907 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.700866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.704373 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.704346 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.710062 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.710040 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.721567 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.721541 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5db\" (UniqueName: \"kubernetes.io/projected/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-kube-api-access-5j5db\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.783916 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.783889 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:13:34.802053 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-sys\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-metrics-client-ca\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgxsn\" (UniqueName: \"kubernetes.io/projected/270efdc7-7967-4f7d-b4f6-b37bc80716e8-kube-api-access-fgxsn\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-textfile\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-wtmp\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-tls\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-root\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802438 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-root\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.802927 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.802908 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-wtmp\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.803168 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.803145 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-textfile\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.803240 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.803210 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-sys\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.803240 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.803212 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.803333 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.803239 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-metrics-client-ca\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.804944 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.804921 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.805331 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.805313 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-tls\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.824991 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.824964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgxsn\" (UniqueName: \"kubernetes.io/projected/270efdc7-7967-4f7d-b4f6-b37bc80716e8-kube-api-access-fgxsn\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.890141 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:34.890112 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:13:34.980797 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:34.980752 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270efdc7_7967_4f7d_b4f6_b37bc80716e8.slice/crio-94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29 WatchSource:0}: Error finding container 94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29: Status 404 returned error can't find the container with id 94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29 Oct 29 23:13:35.011277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.011204 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbqbf" event={"ID":"ef2d1228-d6dd-4398-8c36-4be128ee0e62","Type":"ContainerStarted","Data":"8930bb5c884423ab6de2e2c4a010e81863f5b3229d343279880a165d78a7f783"} Oct 29 23:13:35.012592 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.012560 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j55lx" event={"ID":"270efdc7-7967-4f7d-b4f6-b37bc80716e8","Type":"ContainerStarted","Data":"94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29"} Oct 29 23:13:35.013906 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.013851 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797fcc75d7-bv46z" event={"ID":"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8","Type":"ContainerStarted","Data":"5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6"} Oct 29 23:13:35.298573 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.296038 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp"] Oct 29 23:13:35.303854 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:35.303766 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3213b0b3_2cd9_4c0b_b2be_0b9d6b043fb2.slice/crio-eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62 WatchSource:0}: Error finding container eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62: Status 404 returned error can't find the container with id eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62 Oct 29 23:13:35.833494 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.833399 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:13:35.836376 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.836353 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:35.860414 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860242 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 29 23:13:35.860414 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860252 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 29 23:13:35.860596 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860368 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 29 23:13:35.860596 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860499 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 29 23:13:35.860596 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860546 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 29 23:13:35.860596 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860556 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 29 23:13:35.860779 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860619 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mdhsx\"" Oct 29 23:13:35.860779 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860695 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 29 23:13:35.860779 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.860753 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 29 23:13:35.861129 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.861109 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 29 23:13:35.867132 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:35.867063 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:13:36.012153 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012053 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012153 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012132 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012373 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012435 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.012654 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.012541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.020366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.019620 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsgvx" event={"ID":"f9017cbf-6684-4052-a42c-d48f05c21961","Type":"ContainerStarted","Data":"b39ca984f606742fcf0a3e4b24e617022534cdd711098551de0cccf64e917aad"} Oct 29 23:13:36.020366 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.019680 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsgvx" event={"ID":"f9017cbf-6684-4052-a42c-d48f05c21961","Type":"ContainerStarted","Data":"c4bb13e750c0e1d36b01573d910c5baafc4b5df22e8266b9998df7761c2faf54"} Oct 29 23:13:36.020561 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.020389 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:36.023707 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.023680 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" event={"ID":"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2","Type":"ContainerStarted","Data":"dcf179c636afe35afd450322720c2987f6a788b72c4101b0561b6d46b94bb10c"} Oct 29 23:13:36.023802 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.023738 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" event={"ID":"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2","Type":"ContainerStarted","Data":"e1f403722384bff4a291c6730e41f571176531341a2cf7adc2fb742522425c2f"} Oct 29 23:13:36.023802 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.023773 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" event={"ID":"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2","Type":"ContainerStarted","Data":"eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62"} Oct 29 23:13:36.029701 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.029677 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzd9f" event={"ID":"2da3399e-5270-4bde-82e2-f9743a281797","Type":"ContainerStarted","Data":"32c0cc5957f8d76749ed9ced48d4808c67a0bb20b263108a8229ecc12a6af4a4"} Oct 29 23:13:36.032042 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.032016 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbqbf" event={"ID":"ef2d1228-d6dd-4398-8c36-4be128ee0e62","Type":"ContainerStarted","Data":"095b4a364ad0eb80f48bd9933e05e08eeebc672b62ae507c783def0151e9f11a"} Oct 29 23:13:36.064180 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.064127 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-hsgvx" podStartSLOduration=1.8404565819999998 podStartE2EDuration="4.064109767s" totalImagesPullingTime="2.223653185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:36.062262023 +0000 UTC m=+43.885590830" watchObservedRunningTime="2026-10-29 23:13:36.064109767 +0000 UTC m=+43.887438575" Oct 29 23:13:36.104074 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.104021 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lzd9f" podStartSLOduration=2.071326047 podStartE2EDuration="5.10401128s" totalImagesPullingTime="3.032685233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:36.103898347 +0000 UTC m=+43.927227180" watchObservedRunningTime="2026-10-29 23:13:36.10401128 +0000 UTC m=+43.927340087" Oct 29 23:13:36.113155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113271 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113271 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113271 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113271 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113271 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113271 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.113497 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.113426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.114697 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.114584 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.115681 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.115660 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.116253 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.116190 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.120384 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.119617 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.120384 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.119639 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.120862 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.120818 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.122009 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.121344 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.122177 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.122154 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.126829 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.126808 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.127044 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.127026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.127420 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.127400 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.127773 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.127753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.140882 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.140860 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.174348 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.174301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:13:36.526322 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.526251 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xbqbf" podStartSLOduration=2.686870297 podStartE2EDuration="5.52623653s" totalImagesPullingTime="2.839366233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:36.152010259 +0000 UTC m=+43.975339066" watchObservedRunningTime="2026-10-29 23:13:36.52623653 +0000 UTC m=+44.349565335" Oct 29 23:13:36.532357 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:36.530623 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:13:37.038687 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:37.038427 2580 generic.go:356] "Generic (PLEG): container finished" podID="270efdc7-7967-4f7d-b4f6-b37bc80716e8" containerID="2cfb090a94519199218db27380a247365c559a9b0064ce64adc59687a9fd71c1" exitCode=0 Oct 29 23:13:37.039186 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:37.038522 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j55lx" event={"ID":"270efdc7-7967-4f7d-b4f6-b37bc80716e8","Type":"ContainerDied","Data":"2cfb090a94519199218db27380a247365c559a9b0064ce64adc59687a9fd71c1"} Oct 29 23:13:37.040102 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:37.040075 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"015e2f291580da1e741ebb73ca8a00fc43daa2953a57844961888b7f1cf0a3c5"} Oct 29 23:13:37.043330 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:37.043250 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" event={"ID":"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2","Type":"ContainerStarted","Data":"1c7e6dd99bfef02b34c01ebda4c1ce03f5962b41280a22f7b0c9da271d88d83a"} Oct 29 23:13:37.123911 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:37.123862 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" podStartSLOduration=1.967922481 podStartE2EDuration="3.123843112s" totalImagesPullingTime="1.155920631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:37.123082304 +0000 UTC m=+44.946411136" watchObservedRunningTime="2026-10-29 23:13:37.123843112 +0000 UTC m=+44.947171919" Oct 29 23:13:38.047558 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.047531 2580 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b" exitCode=0 Oct 29 23:13:38.048302 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.047612 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b"} Oct 29 23:13:38.049992 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.049906 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j55lx" event={"ID":"270efdc7-7967-4f7d-b4f6-b37bc80716e8","Type":"ContainerStarted","Data":"c2db0aee97a5ad4852357bb541be2ec442e895bb1020904bcd211888f8c0a539"} Oct 29 23:13:38.049992 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.049949 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j55lx" event={"ID":"270efdc7-7967-4f7d-b4f6-b37bc80716e8","Type":"ContainerStarted","Data":"8ed7e8c9d31502150deb519ac36ccf862db8edb908a2effcac517a4d1952aa41"} Oct 29 23:13:38.051360 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.051337 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797fcc75d7-bv46z" event={"ID":"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8","Type":"ContainerStarted","Data":"f807fd84571da64b6b88520a03559433f3e99b0cd85db2dddeecc2165088597e"} Oct 29 23:13:38.152741 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.152637 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-797fcc75d7-bv46z" podStartSLOduration=1.747910501 podStartE2EDuration="5.152620596s" totalImagesPullingTime="3.404710095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:38.151928037 +0000 UTC m=+45.975256850" watchObservedRunningTime="2026-10-29 23:13:38.152620596 +0000 UTC m=+45.975949402" Oct 29 23:13:38.198676 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:38.198631 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j55lx" podStartSLOduration=2.903775927 podStartE2EDuration="4.198619021s" totalImagesPullingTime="1.195636126s" totalInitContainerRuntime="99.206968ms" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:38.197681243 +0000 UTC m=+46.021010049" watchObservedRunningTime="2026-10-29 23:13:38.198619021 +0000 UTC m=+46.021947826" Oct 29 23:13:39.140437 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.140400 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66f6cfc57-5f9nh"] Oct 29 23:13:39.142579 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.142558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.161924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.161899 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 29 23:13:39.174601 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.174582 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 29 23:13:39.174601 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.174591 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 29 23:13:39.174742 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.174667 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-94pn2\"" Oct 29 23:13:39.174742 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.174717 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 29 23:13:39.174853 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.174802 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9eulmb5p8ehfg\"" Oct 29 23:13:39.176057 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.176035 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f6cfc57-5f9nh"] Oct 29 23:13:39.242565 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.242536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-client-certs\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.242707 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.242598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-tls\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.242707 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.242643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-client-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.242828 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.242743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-metrics-server-audit-profiles\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.242880 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.242858 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2dce7a8-100f-44e1-8409-42b42eef282f-audit-log\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.242963 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.242939 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.243175 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.243103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfj4\" (UniqueName: \"kubernetes.io/projected/b2dce7a8-100f-44e1-8409-42b42eef282f-kube-api-access-jtfj4\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344277 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-client-certs\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344555 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-tls\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344555 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-client-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344555 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-metrics-server-audit-profiles\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344555 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2dce7a8-100f-44e1-8409-42b42eef282f-audit-log\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344555 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344555 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfj4\" (UniqueName: \"kubernetes.io/projected/b2dce7a8-100f-44e1-8409-42b42eef282f-kube-api-access-jtfj4\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.344841 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.344820 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2dce7a8-100f-44e1-8409-42b42eef282f-audit-log\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.345353 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.345331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.345487 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.345468 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-metrics-server-audit-profiles\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.346696 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.346672 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-tls\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.346924 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.346903 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-client-certs\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.346973 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.346957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-client-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.365011 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.364990 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfj4\" (UniqueName: \"kubernetes.io/projected/b2dce7a8-100f-44e1-8409-42b42eef282f-kube-api-access-jtfj4\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.455090 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.455070 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:39.768817 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:39.768745 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66f6cfc57-5f9nh"] Oct 29 23:13:39.771138 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:39.771109 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2dce7a8_100f_44e1_8409_42b42eef282f.slice/crio-d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3 WatchSource:0}: Error finding container d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3: Status 404 returned error can't find the container with id d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3 Oct 29 23:13:40.061363 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:40.061269 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0"} Oct 29 23:13:40.061509 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:40.061372 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b"} Oct 29 23:13:40.061509 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:40.061416 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4"} Oct 29 23:13:40.061509 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:40.061453 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954"} Oct 29 23:13:40.061509 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:40.061491 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4"} Oct 29 23:13:40.062588 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:40.062543 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" event={"ID":"b2dce7a8-100f-44e1-8409-42b42eef282f","Type":"ContainerStarted","Data":"d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3"} Oct 29 23:13:41.069007 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.068973 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerStarted","Data":"f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c"} Oct 29 23:13:41.070511 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.070489 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" event={"ID":"b2dce7a8-100f-44e1-8409-42b42eef282f","Type":"ContainerStarted","Data":"eaff4565d9ea766abec25e67dd0b1c535a50007aac40e7c4a86ca04088029c77"} Oct 29 23:13:41.161312 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.161219 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.457771931 podStartE2EDuration="6.161201204s" totalImagesPullingTime="2.683579458s" totalInitContainerRuntime="19.849815ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:41.147351279 +0000 UTC m=+48.970680086" watchObservedRunningTime="2026-10-29 23:13:41.161201204 +0000 UTC m=+48.984530014" Oct 29 23:13:41.194713 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.194670 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" podStartSLOduration=0.98447011 podStartE2EDuration="2.194656718s" totalImagesPullingTime="1.210186608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:41.193532988 +0000 UTC m=+49.016861796" watchObservedRunningTime="2026-10-29 23:13:41.194656718 +0000 UTC m=+49.017985524" Oct 29 23:13:41.498854 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.498826 2580 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:13:41.501925 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.501902 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.522088 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.522071 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 29 23:13:41.522225 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.522208 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 29 23:13:41.522266 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.522213 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 29 23:13:41.533689 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.533670 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 29 23:13:41.533753 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.533726 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bglshiftfpfve\"" Oct 29 23:13:41.534611 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.534597 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 29 23:13:41.534687 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.534677 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ss9x2\"" Oct 29 23:13:41.546568 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.546549 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 29 23:13:41.546687 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.546550 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 29 23:13:41.546755 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.546684 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 29 23:13:41.546755 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.546700 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 29 23:13:41.546817 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.546771 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 29 23:13:41.547168 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.547152 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 29 23:13:41.547168 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.547167 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 29 23:13:41.547321 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.547186 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 29 23:13:41.558826 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.558809 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 29 23:13:41.560067 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.560050 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:13:41.661511 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661599 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661666 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661699 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661645 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661747 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661731 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661779 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661815 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661861 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661861 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661934 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.661975 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.661932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662050 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662083 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662177 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662162 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662241 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662220 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662318 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662371 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662371 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.662451 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.662385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763652 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763594 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763652 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763652 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.763842 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763971 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.763997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.764016 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.764155 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.764029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.765546 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.765520 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.765640 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.765551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.765640 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.765575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.765640 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.765625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.765778 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.765666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.765778 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.765695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.766197 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.766164 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.767527 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.767417 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.767527 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.767520 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.767968 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.767942 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.768230 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.768202 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.768447 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.768424 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.768539 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.768492 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.768629 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.768603 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.768698 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.768631 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.769137 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.769107 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.769295 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.769254 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.769363 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.769338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.769518 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.769502 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.769793 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.769771 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.770377 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.770356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.770801 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.770784 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.787374 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.787353 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:41.818226 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:41.818203 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:42.153454 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:42.153424 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:13:42.169177 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:42.169154 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9632aa3b_22b3_4d4a_8fe9_97b2e1551ca1.slice/crio-6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69 WatchSource:0}: Error finding container 6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69: Status 404 returned error can't find the container with id 6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69 Oct 29 23:13:43.080033 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:43.079998 2580 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" exitCode=0 Oct 29 23:13:43.080184 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:43.080060 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} Oct 29 23:13:43.080184 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:43.080111 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69"} Oct 29 23:13:44.136167 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:44.136133 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:44.136647 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:44.136228 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:44.141728 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:44.141707 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:45.093272 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:45.093241 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:13:46.093969 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:46.093896 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} Oct 29 23:13:46.094359 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:46.093993 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} Oct 29 23:13:46.980730 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:46.980704 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:13:47.053989 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:47.053956 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hsgvx" Oct 29 23:13:48.110079 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:48.110007 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} Oct 29 23:13:48.110564 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:48.110094 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} Oct 29 23:13:48.110564 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:48.110128 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} Oct 29 23:13:48.110564 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:48.110172 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerStarted","Data":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} Oct 29 23:13:48.176328 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:48.176259 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.765360855 podStartE2EDuration="7.176246253s" totalImagesPullingTime="4.395551078s" totalInitContainerRuntime="15.33432ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:48.175414341 +0000 UTC m=+55.998743173" watchObservedRunningTime="2026-10-29 23:13:48.176246253 +0000 UTC m=+55.999575059" Oct 29 23:13:51.818883 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:51.818848 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:54.891998 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:54.891967 2580 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797fcc75d7-bv46z"] Oct 29 23:13:58.256931 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.256900 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:58.275178 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.275153 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:58.504236 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.504201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:58.504417 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.504252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:58.518259 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.518189 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:13:58.518259 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.518252 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:13:58.527593 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.527566 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:58.527680 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.527590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:58.605037 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.605011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:58.618873 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.618858 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:13:58.640095 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.640078 2580 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:13:58.644986 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.644973 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\"" Oct 29 23:13:58.648063 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.648046 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:58.651829 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.651809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:13:58.668883 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.668863 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\"" Oct 29 23:13:58.675106 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.675085 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:13:58.684748 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.684731 2580 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\"" Oct 29 23:13:58.691838 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.691816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:13:58.955038 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.955016 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rrcsq"] Oct 29 23:13:58.957385 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:58.957351 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf97e9991_dae4_4dfd_a57e_02842e3097f0.slice/crio-0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d WatchSource:0}: Error finding container 0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d: Status 404 returned error can't find the container with id 0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d Oct 29 23:13:58.994686 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:58.994665 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2cx5t"] Oct 29 23:13:58.997362 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:58.997334 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbddaea_9907_436b_9b3f_110cdb69f8ee.slice/crio-c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291 WatchSource:0}: Error finding container c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291: Status 404 returned error can't find the container with id c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291 Oct 29 23:13:59.005682 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.005657 2580 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnstf"] Oct 29 23:13:59.007852 ip-10-0-143-10 kubenswrapper[2580]: W1029 23:13:59.007833 2580 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8549705_e856_4420_9185_66dc04edac7e.slice/crio-751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472 WatchSource:0}: Error finding container 751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472: Status 404 returned error can't find the container with id 751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472 Oct 29 23:13:59.152569 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.152537 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rrcsq" event={"ID":"f97e9991-dae4-4dfd-a57e-02842e3097f0","Type":"ContainerStarted","Data":"0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d"} Oct 29 23:13:59.153711 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.153681 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2cx5t" event={"ID":"bbbddaea-9907-436b-9b3f-110cdb69f8ee","Type":"ContainerStarted","Data":"c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291"} Oct 29 23:13:59.154769 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.154746 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnstf" event={"ID":"c8549705-e856-4420-9185-66dc04edac7e","Type":"ContainerStarted","Data":"751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472"} Oct 29 23:13:59.170037 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.170017 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:13:59.456896 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.456145 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:13:59.457357 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:13:59.456929 2580 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:01.167311 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:14:01.167082 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2cx5t" event={"ID":"bbbddaea-9907-436b-9b3f-110cdb69f8ee","Type":"ContainerStarted","Data":"eb19cb7567096d1210c0aaeec6d8361ca69b21a6cf742830d644146eb6638aa3"} Oct 29 23:14:01.167311 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:14:01.167155 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2cx5t" event={"ID":"bbbddaea-9907-436b-9b3f-110cdb69f8ee","Type":"ContainerStarted","Data":"75a1fb478eb861cc04fe0d81bc58dceaaaa3c9127bda69c56d8f1d6ea22cd274"} Oct 29 23:14:01.207496 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:14:01.207431 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2cx5t" podStartSLOduration=68.141713557 podStartE2EDuration="1m9.207416667s" totalImagesPullingTime="1.06570311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:01.205822653 +0000 UTC m=+69.029151472" watchObservedRunningTime="2026-10-29 23:14:01.207416667 +0000 UTC m=+69.030745510" Oct 29 23:14:02.173780 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:14:02.173748 2580 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnstf" event={"ID":"c8549705-e856-4420-9185-66dc04edac7e","Type":"ContainerStarted","Data":"2cf04e60617189aedd6ad1070b00408080f1bb55c8561c04f045e8c31b38264e"} Oct 29 23:14:02.174153 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:14:02.173875 2580 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:14:02.213400 ip-10-0-143-10 kubenswrapper[2580]: I1029 23:14:02.213344 2580 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xnstf" podStartSLOduration=67.150198415 podStartE2EDuration="1m10.213330126s" totalImagesPullingTime="3.063131711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:02.212197269 +0000 UTC m=+70.035526078" watchObservedRunningTime="2026-10-29 23:14:02.213330126 +0000 UTC m=+70.036658932" Oct 29 23:14:02.478129 ip-10-0-143-10 kubenswrapper[2580]: E1029 23:14:02.478094 2580 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:14:03.769645 ip-10-0-143-10 systemd[1]: Stopping Kubernetes Kubelet... Oct 29 23:14:03.793692 ip-10-0-143-10 systemd[1]: kubelet.service: Deactivated successfully. Oct 29 23:14:03.793861 ip-10-0-143-10 systemd[1]: Stopped Kubernetes Kubelet. Oct 29 23:14:03.794040 ip-10-0-143-10 systemd[1]: kubelet.service: Consumed 3.994s CPU time. Oct 29 23:14:03.808874 ip-10-0-143-10 systemd[1]: Starting Kubernetes Kubelet... Oct 29 23:14:03.869325 ip-10-0-143-10 kubenswrapper[6133]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:14:03.869325 ip-10-0-143-10 kubenswrapper[6133]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 29 23:14:03.869325 ip-10-0-143-10 kubenswrapper[6133]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:14:03.869325 ip-10-0-143-10 kubenswrapper[6133]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 29 23:14:03.872215 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872142 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.872215 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872213 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.872215 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872218 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.872215 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872221 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872225 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872228 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872230 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872234 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872236 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872239 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872242 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872245 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872248 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872250 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872253 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872256 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872258 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872261 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872264 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872266 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872269 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872271 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.872401 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872274 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872277 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872293 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872297 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872299 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872302 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872305 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872307 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872310 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872317 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872320 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872323 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872325 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872329 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872332 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872334 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872337 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872340 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872343 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872346 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.872891 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872349 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872352 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872354 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872357 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872359 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872362 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872364 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872367 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872370 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872372 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872375 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872377 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872380 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872383 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872386 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872389 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872391 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872394 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872396 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872399 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.873418 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872402 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872405 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872407 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872410 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872414 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872417 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872419 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872423 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872425 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872428 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872431 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872434 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872436 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872439 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872441 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872444 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872448 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872452 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872455 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.873919 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872458 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872460 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872466 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872470 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872474 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872477 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872480 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872482 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872485 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872488 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872491 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872493 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872504 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872507 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872510 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872513 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872515 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872518 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872520 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.874385 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872524 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872528 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872531 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872533 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872536 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.872539 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873273 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873305 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873311 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873315 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873319 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873322 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873325 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873329 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873334 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873337 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873341 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873344 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873348 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.874864 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873351 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873353 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873356 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873359 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873362 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873365 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873367 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873370 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873373 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873375 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873378 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873381 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873383 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873386 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873389 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873392 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873394 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873397 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873399 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.875358 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873402 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873404 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873407 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873410 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873412 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873415 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873418 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873420 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873423 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873426 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873429 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873433 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873436 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873438 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873441 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873444 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873446 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873449 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873451 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.875847 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873454 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873456 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873459 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873462 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873465 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873467 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873470 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873473 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873475 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873478 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873480 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873483 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873485 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873488 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873490 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873493 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873495 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873498 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873501 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.876347 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873504 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873507 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873509 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873512 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873514 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873517 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873521 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873524 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873526 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873529 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873531 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873534 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873536 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873539 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873542 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873544 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873547 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873549 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873552 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873555 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.876887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873557 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873560 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873564 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873567 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873570 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873573 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873575 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873578 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873581 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873583 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873587 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873594 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873597 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873600 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873603 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.873606 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874090 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874096 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874101 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.877384 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874104 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874107 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874111 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874114 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874117 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874119 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874122 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874125 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874127 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874130 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874132 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874135 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874138 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874140 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874143 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874147 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874149 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874152 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874155 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.877887 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874158 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874160 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874163 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874166 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874170 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874174 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874177 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874179 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874182 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874185 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874189 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874193 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874196 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874199 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874202 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874205 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874208 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874210 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874213 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.878397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874216 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874218 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874221 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874224 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874228 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874231 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874234 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874236 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874239 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874246 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874249 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874252 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874254 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874257 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874260 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874263 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874265 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874268 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874271 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874273 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.878858 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874276 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874294 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874299 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874303 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874307 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874311 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874314 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874318 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874321 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874324 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874326 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874329 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874332 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874334 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874337 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874340 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874345 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874347 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874350 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.879456 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874352 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874355 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874359 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874361 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874364 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874366 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874369 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874372 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874374 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874377 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874379 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874382 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874385 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874387 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874390 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874393 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874395 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874398 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874401 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874404 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.879931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874406 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874409 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874412 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874415 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874418 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.874420 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874513 6133 flags.go:64] FLAG: --address="0.0.0.0" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874524 6133 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874530 6133 flags.go:64] FLAG: --anonymous-auth="true" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874536 6133 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874540 6133 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874543 6133 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874547 6133 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874551 6133 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874556 6133 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874559 6133 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874563 6133 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874566 6133 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874569 6133 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874573 6133 flags.go:64] FLAG: --cgroup-root="" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874575 6133 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874579 6133 flags.go:64] FLAG: --client-ca-file="" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874581 6133 flags.go:64] FLAG: --cloud-provider="external" Oct 29 23:14:03.880439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874584 6133 flags.go:64] FLAG: --cluster-dns="[]" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874589 6133 flags.go:64] FLAG: --cluster-domain="" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874592 6133 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874595 6133 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874598 6133 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874602 6133 flags.go:64] FLAG: --container-log-max-files="5" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874606 6133 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874609 6133 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874612 6133 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874616 6133 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874619 6133 flags.go:64] FLAG: --contention-profiling="false" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874629 6133 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874632 6133 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874635 6133 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874638 6133 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874648 6133 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874651 6133 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874654 6133 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874659 6133 flags.go:64] FLAG: --enable-load-reader="false" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874662 6133 flags.go:64] FLAG: --enable-server="true" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874665 6133 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874669 6133 flags.go:64] FLAG: --event-burst="100" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874673 6133 flags.go:64] FLAG: --event-qps="50" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874677 6133 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 29 23:14:03.881004 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874680 6133 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874683 6133 flags.go:64] FLAG: --eviction-hard="" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874687 6133 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874690 6133 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874693 6133 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874697 6133 flags.go:64] FLAG: --eviction-soft="" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874700 6133 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874703 6133 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874706 6133 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874709 6133 flags.go:64] FLAG: --experimental-mounter-path="" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874712 6133 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874715 6133 flags.go:64] FLAG: --fail-swap-on="true" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874718 6133 flags.go:64] FLAG: --feature-gates="" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874722 6133 flags.go:64] FLAG: --file-check-frequency="20s" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874725 6133 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874728 6133 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874731 6133 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874734 6133 flags.go:64] FLAG: --healthz-port="10248" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874738 6133 flags.go:64] FLAG: --help="false" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874741 6133 flags.go:64] FLAG: --hostname-override="ip-10-0-143-10.ec2.internal" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874744 6133 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874747 6133 flags.go:64] FLAG: --http-check-frequency="20s" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874750 6133 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874753 6133 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 29 23:14:03.881618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874757 6133 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874760 6133 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874764 6133 flags.go:64] FLAG: --image-service-endpoint="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874767 6133 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874770 6133 flags.go:64] FLAG: --kube-api-burst="100" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874773 6133 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874776 6133 flags.go:64] FLAG: --kube-api-qps="50" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874780 6133 flags.go:64] FLAG: --kube-reserved="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874783 6133 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874786 6133 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874789 6133 flags.go:64] FLAG: --kubelet-cgroups="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874792 6133 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874795 6133 flags.go:64] FLAG: --lock-file="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874797 6133 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874800 6133 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874803 6133 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874809 6133 flags.go:64] FLAG: --log-json-split-stream="false" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874812 6133 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874815 6133 flags.go:64] FLAG: --log-text-split-stream="false" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874817 6133 flags.go:64] FLAG: --logging-format="text" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874820 6133 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874824 6133 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874827 6133 flags.go:64] FLAG: --manifest-url="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874830 6133 flags.go:64] FLAG: --manifest-url-header="" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874834 6133 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 29 23:14:03.882246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874837 6133 flags.go:64] FLAG: --max-open-files="1000000" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874841 6133 flags.go:64] FLAG: --max-pods="110" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874844 6133 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874847 6133 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874850 6133 flags.go:64] FLAG: --memory-manager-policy="None" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874853 6133 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874857 6133 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874860 6133 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874863 6133 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874872 6133 flags.go:64] FLAG: --node-status-max-images="50" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874875 6133 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874878 6133 flags.go:64] FLAG: --oom-score-adj="-999" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874881 6133 flags.go:64] FLAG: --pod-cidr="" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874885 6133 flags.go:64] FLAG: --pod-manifest-path="" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874888 6133 flags.go:64] FLAG: --pod-max-pids="-1" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874892 6133 flags.go:64] FLAG: --pods-per-core="0" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874895 6133 flags.go:64] FLAG: --port="10250" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874898 6133 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874900 6133 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08d6c99b4308cff0e" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874904 6133 flags.go:64] FLAG: --qos-reserved="" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874907 6133 flags.go:64] FLAG: --read-only-port="10255" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874910 6133 flags.go:64] FLAG: --register-node="true" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874913 6133 flags.go:64] FLAG: --register-with-taints="" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874917 6133 flags.go:64] FLAG: --registry-burst="10" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874919 6133 flags.go:64] FLAG: --registry-qps="5" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874922 6133 flags.go:64] FLAG: --reserved-cpus="" Oct 29 23:14:03.882865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874925 6133 flags.go:64] FLAG: --reserved-memory="" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874929 6133 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874932 6133 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874935 6133 flags.go:64] FLAG: --rotate-certificates="false" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874938 6133 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874941 6133 flags.go:64] FLAG: --runonce="false" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874944 6133 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874947 6133 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874950 6133 flags.go:64] FLAG: --seccomp-default="false" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874953 6133 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874956 6133 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874959 6133 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874963 6133 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874966 6133 flags.go:64] FLAG: --storage-driver-password="root" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874968 6133 flags.go:64] FLAG: --storage-driver-secure="false" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874973 6133 flags.go:64] FLAG: --storage-driver-table="stats" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874976 6133 flags.go:64] FLAG: --storage-driver-user="root" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874979 6133 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874982 6133 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874985 6133 flags.go:64] FLAG: --system-cgroups="" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874988 6133 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874993 6133 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874996 6133 flags.go:64] FLAG: --tls-cert-file="" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.874999 6133 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875003 6133 flags.go:64] FLAG: --tls-min-version="" Oct 29 23:14:03.883580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875006 6133 flags.go:64] FLAG: --tls-private-key-file="" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875009 6133 flags.go:64] FLAG: --topology-manager-policy="none" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875012 6133 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875015 6133 flags.go:64] FLAG: --topology-manager-scope="container" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875018 6133 flags.go:64] FLAG: --v="2" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875022 6133 flags.go:64] FLAG: --version="false" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875026 6133 flags.go:64] FLAG: --vmodule="" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875030 6133 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875033 6133 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875158 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875162 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875165 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875167 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875170 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875173 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875176 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875178 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875181 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875183 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875187 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875190 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.884381 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875193 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875196 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875199 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875202 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875205 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875209 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875213 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875216 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875219 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875221 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875224 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875227 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875229 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875232 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875235 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875237 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875240 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875243 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875246 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.885245 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875248 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875251 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875253 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875256 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875259 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875261 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875264 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875267 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875269 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875272 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875274 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875277 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875293 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875296 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875300 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875303 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875305 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875308 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875310 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875313 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.885921 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875316 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875319 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875322 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875324 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875327 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875329 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875332 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875335 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875339 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875342 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875346 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875349 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875352 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875355 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875358 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875362 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875365 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875368 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875371 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.886806 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875374 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875376 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875379 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875382 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875384 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875387 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875390 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875393 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875396 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875398 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875401 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875404 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875407 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875410 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875412 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875415 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875417 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875420 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875422 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875425 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.887653 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875428 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875430 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875433 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875435 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875438 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875440 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875442 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875445 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875449 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875451 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875454 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875457 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875459 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875462 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875464 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875467 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.888414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.875491 6133 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875525 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875530 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875535 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875540 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875543 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875546 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875548 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875551 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875553 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875556 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875558 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875561 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875564 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875566 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875569 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875572 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875575 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875577 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.888931 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875580 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875582 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875585 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875587 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875590 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875594 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875596 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875599 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875601 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875604 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875607 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875609 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875612 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875615 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875617 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875620 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875622 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875625 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875628 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875631 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.889434 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875633 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875636 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875638 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875641 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875643 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875646 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875650 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875654 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875657 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875661 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875664 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875666 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875669 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875671 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875674 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875676 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875679 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875683 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875685 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.889907 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875688 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875691 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875693 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875696 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875698 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875701 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875704 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875706 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875709 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875712 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875714 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875717 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875720 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875722 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875725 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875728 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875731 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875733 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875736 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.890392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875739 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875741 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875744 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875746 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875749 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875751 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875754 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875756 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875759 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875761 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875764 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875767 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875770 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875773 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875777 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875779 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875782 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875785 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875787 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875790 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.890873 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875792 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875795 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875797 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875800 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875803 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875807 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875809 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875812 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875814 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.875817 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.879232 6133 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.879246 6133 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.879263 6133 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.879268 6133 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879341 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879347 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879350 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879353 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879356 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.891377 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879359 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879362 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879364 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879367 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879370 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879372 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879375 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879378 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879380 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879383 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879386 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879388 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879391 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879394 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879397 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879399 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879402 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879405 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879408 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879411 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.891850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879414 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879418 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879420 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879423 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879425 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879428 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879431 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879433 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879436 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879439 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879441 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879444 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879446 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879449 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879451 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879454 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879457 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879460 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879463 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879466 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.892342 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879469 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879472 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879475 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879477 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879480 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879483 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879485 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879488 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879490 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879493 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879495 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879499 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879502 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879504 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879507 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879509 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879512 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879514 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879517 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.892823 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879520 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879522 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879525 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879528 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879531 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879534 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879536 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879539 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879542 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879544 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879547 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879551 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879555 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879558 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879562 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879565 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879568 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879571 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879574 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879576 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.893354 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879579 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879581 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879584 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879586 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879589 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879593 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879596 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879599 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879601 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879604 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879607 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879609 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879612 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879615 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879617 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879620 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879623 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879626 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879628 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.893850 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879631 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879633 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879636 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.879662 6133 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879804 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879809 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879812 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879815 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879817 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879820 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879823 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879825 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879828 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879831 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879834 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.894330 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879836 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879839 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879841 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879844 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879847 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879850 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879852 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879854 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879857 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879860 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879863 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879866 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879868 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879871 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879873 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879876 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879879 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879881 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879883 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879886 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.894681 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879888 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879891 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879894 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879896 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879900 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879903 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879906 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879909 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879912 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879915 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879917 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879920 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879922 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879925 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879928 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879930 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879933 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879936 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879939 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.895164 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879942 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879944 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879947 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879949 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879952 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879954 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879957 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879959 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879962 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879964 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879967 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879969 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879972 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879974 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879977 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879979 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879982 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879984 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879987 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879989 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.895640 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879992 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879994 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.879997 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880000 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880004 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880008 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880011 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880014 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880017 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880019 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880022 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880025 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880028 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880030 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880033 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880035 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880038 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880040 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880043 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880045 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.896133 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880048 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880050 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880053 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880055 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880058 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880060 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880063 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880066 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880068 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880071 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880074 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880076 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880082 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880085 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880088 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880090 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.896670 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.880113 6133 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880145 6133 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880149 6133 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880152 6133 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880155 6133 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880158 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880160 6133 feature_gate.go:386] unrecognized feature gate: Example2 Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880163 6133 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880166 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880169 6133 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880172 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880176 6133 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880180 6133 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880183 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880186 6133 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880194 6133 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880197 6133 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880199 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880202 6133 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880205 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 29 23:14:03.897061 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880207 6133 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880210 6133 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880213 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880216 6133 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880219 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880221 6133 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880224 6133 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880227 6133 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880229 6133 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880233 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880236 6133 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880238 6133 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880241 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880243 6133 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880246 6133 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880249 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880252 6133 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880254 6133 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880257 6133 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 29 23:14:03.897597 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880259 6133 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880262 6133 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880265 6133 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880268 6133 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880271 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880273 6133 feature_gate.go:386] unrecognized feature gate: EVPN Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880276 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880292 6133 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880297 6133 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880300 6133 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880303 6133 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880305 6133 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880308 6133 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880311 6133 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880314 6133 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880316 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880319 6133 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880321 6133 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880324 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 29 23:14:03.898128 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880328 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880330 6133 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880333 6133 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880337 6133 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880340 6133 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880342 6133 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880345 6133 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880348 6133 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880350 6133 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880353 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880356 6133 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880358 6133 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880361 6133 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880363 6133 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880366 6133 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880369 6133 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880372 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880375 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880377 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 29 23:14:03.898628 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880380 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880384 6133 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880389 6133 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880392 6133 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880394 6133 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880397 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880400 6133 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880403 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880405 6133 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880408 6133 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880410 6133 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880414 6133 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880417 6133 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880420 6133 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880422 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880425 6133 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880429 6133 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880432 6133 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880434 6133 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 29 23:14:03.899424 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880437 6133 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880439 6133 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880442 6133 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880445 6133 feature_gate.go:386] unrecognized feature gate: Example Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880448 6133 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880451 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880454 6133 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880456 6133 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880459 6133 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880462 6133 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:03.880464 6133 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.880516 6133 server.go:957] "Client rotation is on, will bootstrap in background" Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.881483 6133 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.881531 6133 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.881697 6133 server.go:1014] "Starting client certificate rotation" Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.881841 6133 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.881884 6133 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:52 +0000 UTC" deadline="2028-07-19 10:57:30.459911624 +0000 UTC" Oct 29 23:14:03.900250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.881919 6133 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15083h43m26.577994922s" Oct 29 23:14:03.900971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.882112 6133 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:14:03.900971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.883074 6133 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 29 23:14:03.900971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.885042 6133 log.go:25] "Validated CRI v1 runtime API" Oct 29 23:14:03.900971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.887805 6133 log.go:25] "Validated CRI v1 image API" Oct 29 23:14:03.900971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.888599 6133 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 29 23:14:03.900971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.890506 6133 fs.go:135] Filesystem UUIDs: map[52f5c5ec-e1d9-4222-b047-d1b20b5554e8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f84dfab7-edfd-4b7c-a795-333d4e901eed:/dev/nvme0n1p3] Oct 29 23:14:03.901328 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.890525 6133 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/015e2f291580da1e741ebb73ca8a00fc43daa2953a57844961888b7f1cf0a3c5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/015e2f291580da1e741ebb73ca8a00fc43daa2953a57844961888b7f1cf0a3c5/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d/userdata/shm major:0 minor:412 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6/userdata/shm major:0 minor:227 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69/userdata/shm major:0 minor:374 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472/userdata/shm major:0 minor:416 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2/userdata/shm major:0 minor:70 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d/userdata/shm major:0 minor:71 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a/userdata/shm major:0 minor:100 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a0f3839c516d560a61fab5f45c5cbeb741ccb57c2b1709a7a9a596361d15440f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a0f3839c516d560a61fab5f45c5cbeb741ccb57c2b1709a7a9a596361d15440f/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2/userdata/shm major:0 minor:96 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291/userdata/shm major:0 minor:414 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~projected/kube-api-access-fgxsn:{mountpoint:/var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~projected/kube-api-access-fgxsn major:0 minor:240 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:238 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:239 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volumes/kubernetes.io~projected/kube-api-access-dvspl:{mountpoint:/var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volumes/kubernetes.io~projected/kube-api-access-dvspl major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2da3399e-5270-4bde-82e2-f9743a281797/volumes/kubernetes.io~projected/kube-api-access-7d2hp:{mountpoint:/var/lib/kubelet/pods/2da3399e-5270-4bde-82e2-f9743a281797/volumes/kubernetes.io~projected/kube-api-access-7d2hp major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2da3399e-5270-4bde-82e2-f9743a281797/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/2da3399e-5270-4bde-82e2-f9743a281797/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~projected/kube-api-access-5j5db:{mountpoint:/var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~projected/kube-api-access-5j5db major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3696b0b9-b3d7-479f-be52-853834548a9a/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/3696b0b9-b3d7-479f-be52-853834548a9a/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3aa46c84-d4da-4894-83f5-bfe0bb886c42/volumes/kubernetes.io~projected/kube-api-access-8t42k:{mountpoint:/var/lib/kubelet/pods/3aa46c84-d4da-4894-83f5-bfe0bb886c42/volumes/kubernetes.io~projected/kube-api-access-8t42k major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/655998f3-b29e-47f0-9d86-04af9ff2d347/volumes/kubernetes.io~projected/kube-api-access-ssrns:{mountpoint:/var/lib/kubelet/pods/655998f3-b29e-47f0-9d86-04af9ff2d347/volumes/kubernetes.io~projected/kube-api-access-ssrns major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79bb54aa-20a3-4a69-8215-26b2f006e219/volumes/kubernetes.io~projected/kube-api-access-9jj2n:{mountpoint:/var/lib/kubelet/pods/79bb54aa-20a3-4a69-8215-26b2f006e219/volumes/kubernetes.io~projected/kube-api-access-9jj2n major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/80f71f2d-d8d2-4097-a190-b52b04d11212/volumes/kubernetes.io~projected/kube-api-access-z4z6s:{mountpoint:/var/lib/kubelet/pods/80f71f2d-d8d2-4097-a190-b52b04d11212/volumes/kubernetes.io~projected/kube-api-access-z4z6s major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~projected/kube-api-access-fpxwh:{mountpoint:/var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~projected/kube-api-access-fpxwh major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9107266c-733c-4bcd-8c8c-679ac2d5186f/volumes/kubernetes.io~projected/kube-api-access-m4wwf:{mountpoint:/var/lib/kubelet/pods/9107266c-733c-4bcd-8c8c-679ac2d5186f/volumes/kubernetes.io~projected/kube-api-access-m4wwf major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/config-reloader/2 major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/prometheus/15 major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~empty-dir/config-out major:0 minor:358 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~projected/kube-api-access-n7h2s:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~projected/kube-api-access-n7h2s major:0 minor:373 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~projected/tls-assets major:0 minor:367 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/config major:0 minor:366 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:368 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:370 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:364 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:365 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:372 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:371 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:369 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/web-config major:0 minor:363 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~projected/kube-api-access-gjxsr:{mountpoint:/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~projected/kube-api-access-gjxsr major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~projected/kube-api-access-jtfj4:{mountpoint:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~projected/kube-api-access-jtfj4 major:0 minor:319 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/client-ca-bundle:{mountpoint:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/client-ca-bundle major:0 minor:326 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/secret-metrics-server-client-certs:{mountpoint:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/secret-metrics-server-client-certs major:0 minor:325 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/secret-metrics-server-tls:{mountpoint:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/secret-metrics-server-tls major:0 minor:324 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/alertmanager/9 major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/config-reloader/6 major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~empty-dir/config-out major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~projected/kube-api-access-qp4f8:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~projected/kube-api-access-qp4f8 major:0 minor:291 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~projected/tls-assets major:0 minor:273 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:290 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/config-volume major:0 minor:283 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/web-config major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bbbddaea-9907-436b-9b3f-110cdb69f8ee/volumes/kubernetes.io~projected/kube-api-access-fq27d:{mountpoint:/var/lib/kubelet/pods/bbbddaea-9907-436b-9b3f-110cdb69f8ee/volumes/kubernetes.io~projected/kube-api-access-fq27d major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bbbddaea-9907-436b-9b3f-110cdb69f8ee/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/bbbddaea-9907-436b-9b3f-110cdb69f8ee/volumes/kubernetes.io~secret/metrics-certs major:0 minor:406 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c8549705-e856-4420-9185-66dc04edac7e/volumes/kubernetes.io~projected/kube-api-access-v9klr:{mountpoint:/var/lib/kubelet/pods/c8549705-e856-4420-9185-66dc04edac7e/volumes/kubernetes.io~projected/kube-api-access-v9klr major:0 minor:411 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d925d9a8-26ee-448e-bc33-007661c3414a/volumes/kubernetes.io~projected/kube-api-access-lg9fw:{mountpoint:/var/lib/kubelet/pods/d925d9a8-26ee-448e-bc33-007661c3414a/volumes/kubernetes.io~projected/kube-api-access-lg9fw major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef2d1228-d6dd-4398-8c36-4be128ee0e62/volumes/kubernetes.io~projected/kube-api-access-8s6cp:{mountpoint:/var/lib/kubelet/pods/ef2d1228-d6dd-4398-8c36-4be128ee0e62/volumes/kubernetes.io~projected/kube-api-access-8s6cp major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ef2d1228-d6dd-4398-8c36-4be128ee0e62/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/ef2d1228-d6dd-4398-8c36-4be128ee0e62/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9017cbf-6684-4052-a42c-d48f05c21961/volumes/kubernetes.io~projected/kube-api-access-lgcdb:{mountpoint:/var/lib/kubelet/pods/f9017cbf-6684-4052-a42c-d48f05c21961/volumes/kubernetes.io~projected/kube-api-access-lgcdb major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f9017cbf-6684-4052-a42c-d48f05c21961/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/f9017cbf-6684-4052-a42c-d48f05c21961/volumes/kubernetes.io~secret/metrics-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f97e9991-dae4-4dfd-a57e-02842e3097f0/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/f97e9991-dae4-4dfd-a57e-02842e3097f0/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:410 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/bd4fe62c1ec288232e632553c4469689fb6691b384c606469d733a58aa66f652/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/5f32d309f095d88e3b4d3eac393e31f346d4f66c192a316276430b1c1e427b53/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/4094aaaed78151162b6b0e213ab0c5c500e432d3f07edcd897920dca4021da58/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/b9c008ec5f0603593fed384a3fe018c1df525ea8773a9cf7da0fee59d972e685/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/f052d0c8f7772d86c17803800e6c6bf314974ca6bb10eec7b729cf52241406d6/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/7bff2724e2622c5231766b6c0168be8aebadfb170807cce0dff3b32b1c5fbfe0/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/b15c6c6df515ee87309be595d681843caf45d539dbd1513319576e0954ea6eb6/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/d9f2fde9de06af2849c9032cd0bccafa9ce2625f5604c9cbabf840b64797c0a4/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/12afdbad2d0b1fa54363e53d86ce299433988d5c20defcd3b26755e9e894b8b7/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/d529be44b2509d3706e5059b0176f93f258d1a1a216fe57dee09957e8dc24854/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/61be582dcfe34aa9a70d4208c1e8b6fe808997021ac522bd068641eef4948672/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/97539f9573e83a50c2e10da4cfc3773aa9d76c09b9251bb589aa0427e044b388/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/5e1cd650cddf0ec58f371e1cff65c66f41b34abea01c378c9d4ea0d5bb3c9a51/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/8d3986d70f15a38fd608a464c8946a8a3931b92b50be441f5355a22de8297b41/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/aeeecd6045e78078fdd9da15442a211e564741a18eebdf711be94dc7832eaa0a/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/57ef443c2f5a69971630b022e5d0303d75b5af0f0b56662be4ba7a9b1c5bac60/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/bfee3c325a826cc05e823b9226eb4eecbaec2d0bf6429a638b49f06cdb9e9bc1/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/05839e439835441e8b5b2cf99aaee9f5966bbde982511d81feb0a073e1d822b2/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/52cf6d5baeb777415103575e437de42a8274acecc0f9111207eccd2025dc7356/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/d605e9d39f2009fcad7f031bea6a05d9913f49da1b7cccc9a46828a8c71a83fd/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/f9bb618bea5e41a4c3fe5b816604af3edab201dea62b3797acf0a16acd5501e7/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/89a74d4f5ff88b642fe5cf5ab9d01a908786f30d0e8b9542ee15e61482d66277/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/fde79abd01946d97652b7c3a53b025ce32e83b69a68f1508aa9debf92ded6525/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/8655065e799ce357a420fcd1fac239af3adebb90f8528e31b31b226513a33a96/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/612404261dec9d89c92ebf1d4c48c7384ff13d74bd92741f3b953e11d592c8d6/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/92b3f931af202236511c1a76642fb1f1ca24e850f3093836de0be2b63c2b7357/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-245:{mountpoint:/var/lib/containers/storage/overlay/6a44afd54f2d158b7d48eeee842a6191335ddcef9bd697c2d6d5415c34b9a828/merged major:0 minor:245 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/80fa9b017740e070b6917c04544fae3d3bc6ed63b1e168d1a009fafe3eb4041d/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-249:{mountpoint:/var/lib/containers/storage/overlay/d44ed82cfb964afc2afc5882b9d869b7c001cbbe806e0bbfab7248ed44abf49c/merged major:0 minor:249 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/ccafdd25c705837cb6886c72a6882115ba537f0dda6a8001d037eb18f7cd6bba/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/7e96da6f18e74408d742d5e8eb977796c49bac148465e16035614eeb4320718c/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/88a6232e12b9bb3bb2522afc765cb748dd42b005bf73c854534b4f6a5ec3ab03/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/c28ce6ce2654447a67a9f57abc08061ba73cbf4804d854c1d9199c864203cb06/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/5fba56ceb6fdf3f40ae21a8fc9d2138c4f4b4cf9c4d88c79be392ce5f5f7855a/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/db8a12787c426d76bdfb36053e3bf53cbfefb5521546e82340cd9513ffb00f2c/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/fd3bf10a3afa9dac6eb8dad06cdea5f6a94e420eb237f0aad82f5c5ea3f141c1/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/0cdc4ed108dcb00fb0775640cc25bbce06110a9e1bc15f16f0b01a0127d3349e/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/b820ca5ad2bfe6310f5a7a18607268d2545821dfe696295f4650af3ec5065e4f/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/9c08564959d222056a3d253ed3e4f95fef56d436e461f15d9dd5e7c58675a9be/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/181fe2529d9de50905c708de174c233c750d8c8ffbcb1731e91da2a0380eaf16/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/dcd482acbc1d1e4c0d900a6b73816a9329c6623ddcaeff4d13a49365680e6b40/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-329:{mountpoint:/var/lib/containers/storage/overlay/bf920dddf615e4c57901f7e75b772394939c0a177f4d0fdb5b74da3a38d851ef/merged major:0 minor:329 fsType:overlay blockSize:0} overlay_0-339:{mountpoint:/var/lib/containers/storage/overlay/48f27eedc198d5d9e98564c1b8595839ec42c2d70fafae4fdb3b633c19344f41/merged major:0 minor:339 fsType:overlay blockSize:0} overlay_0-341:{mountpoint:/var/lib/containers/storage/overlay/99f42e6a4b69642ec991ee18af8dbeb889d57a5ed99807531dc23d7b70f35a2c/merged major:0 minor:341 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/f6d4a0e42b627042ac5d3665046331af83a4ffcaa37a255dac470d29174863a9/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-351:{mountpoint:/var/lib/containers/storage/overlay/cdd6a8c0fe0c8be798f866bde234ace70d5556c0f696c992345c2a2393d8ccc1/merged major:0 minor:351 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/fb6911751fad3f176c99b3d5ab0c2dd5d7cb188341da61f0000a8351b40b59b3/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/c2f7e15cd5c13b7e39eb8ba3f85ab0af2562e494087bac8ed304059544b9f6b4/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-378:{mountpoint:/var/lib/containers/storage/overlay/47db8f31df058ac134833875cb8c7d11ed5b66ba90ed83653b487aabbf8f834f/merged major:0 minor:378 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/ba90e7124b98d075f154265c258063c04b1f613355e70d01645c943534ed7684/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-386:{mountpoint:/var/lib/containers/storage/overlay/206f90f7acd0e0f6ce91414f4431e2d6ccffae3921019e9b1c7bd6f01aca969f/merged major:0 minor:386 fsType:overlay blockSize:0} overlay_0-391:{mountpoint:/var/lib/containers/storage/overlay/d45dba31cd0d30a3e322412ceac436d16b5a127002a2f630c52e5ce4c63fd742/merged major:0 minor:391 fsType:overlay blockSize:0} overlay_0-396:{mountpoint:/var/lib/containers/storage/overlay/edf3952f7a14a89d5b3db986f7f749e8c5df49376359c91ebd34d81ac3ea1a6c/merged major:0 minor:396 fsType:overlay blockSize:0} overlay_0-401:{mountpoint:/var/lib/containers/storage/overlay/ef692570cd4310f72353b8d0f4481202e6de5761c036416476cbc58183e9cab6/merged major:0 minor:401 fsType:overlay blockSize:0} overlay_0-418:{mountpoint:/var/lib/containers/storage/overlay/a2a2e73724ccf44c5e33bfb1448e94ea84d949e6ad6e7202d9e5810bb3dc37f4/merged major:0 minor:418 fsType:overlay blockSize:0} overlay_0-420:{mountpoint:/var/lib/containers/storage/overlay/2bf7fcef6d37f78dbca45b0acae002fceabcd39693ec410d87f8acc04c7ddcda/merged major:0 minor:420 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/6810c4a585921a14c7d03e019c146f1bf3d33154d43204ef3644ee6bb3a25810/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-424:{mountpoint:/var/lib/containers/storage/overlay/c708568821e06a73500520f35ff9b0eea0a731722b32ccccbbbc310b32372352/merged major:0 minor:424 fsType:overlay blockSize:0} overlay_0-426:{mountpoint:/var/lib/containers/storage/overlay/3f19b21c76ef2b0d6d45305f77eeebcb70e63d50a7cbcbbef557c94c97b0a4be/merged major:0 minor:426 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/d836af0260e4f5714d5e7778835a35aecc6b7fc64a9ee6f9a34573aaaf611dcc/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/80d9b7d76411ef7b1f315150d9094d7be853cdfb1d1c78711768b66f4898f986/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/3efabed993494b7ba7530a31f86b8a22eed5e7e9c68052b8471874c87a514186/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/011fd311511d11e82f3f5b3aee2c9de5fb3423af19c1a6fd9063bdba43dc3218/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-68:{mountpoint:/var/lib/containers/storage/overlay/ff440182a998096a6770bfd2a3d81870df25a06cd913234fbc5b456dc5c7a4db/merged major:0 minor:68 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/361a4db8cff18262048d08318cdabb3fe26d0b6f673833150df459f6816d536e/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/c15f0f7fe23a9ece49861ac3151b634e06207584b1a069fa850988532e5c30ed/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/fb6e41878ca44b0f89720dcc7b3191cfa28692043235b8caa650096b59ff2a14/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/3f121a181736a33745162b0122785cf421e8e2a9f1a049bbaa4ea6dfe6ea35b4/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/7530cba0a6c0b71ad8825acf493f0400f4e5c887ec9fe42f7267207e1a22d38a/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/adb8b86101ede52ad2d050cc6e87c2bfe01b8f13b20e48ac4ce039e3ab1f4ff6/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/2ded41b4d501a74e681cf200303e84ff759578ddbafc7390d126280d64eea99a/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-98:{mountpoint:/var/lib/containers/storage/overlay/e066944ce4bb03a47e325bb4c8111f07ac13954d400b7c0c5dc60b07ea594669/merged major:0 minor:98 fsType:overlay blockSize:0}] Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.897515 6133 manager.go:217] Machine: {Timestamp:2026-10-29 23:14:03.897059129 +0000 UTC m=+0.058246694 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204819 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21649f061827b3df135b87ee6981c0 SystemUUID:ec21649f-0618-27b3-df13-5b87ee6981c0 BootID:17bce9fc-054b-44ac-a8e4-e5ce65eb7504 Filesystems:[{Device:/var/lib/kubelet/pods/bbbddaea-9907-436b-9b3f-110cdb69f8ee/volumes/kubernetes.io~projected/kube-api-access-fq27d DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2da3399e-5270-4bde-82e2-f9743a281797/volumes/kubernetes.io~projected/kube-api-access-7d2hp DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3aa46c84-d4da-4894-83f5-bfe0bb886c42/volumes/kubernetes.io~projected/kube-api-access-8t42k DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/ef2d1228-d6dd-4398-8c36-4be128ee0e62/volumes/kubernetes.io~projected/kube-api-access-8s6cp DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:358 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-424 DeviceMajor:0 DeviceMinor:424 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-426 DeviceMajor:0 DeviceMinor:426 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:363 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/751273d012f5e528b7e2753d31d6dfb48ae8e6aadb8bb43d3e50eb2e1c2dd472/userdata/shm DeviceMajor:0 DeviceMinor:416 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/791a94d987be24d6854799dc569d39e569e20bfc343e595ab90edbfec97f61b2/userdata/shm DeviceMajor:0 DeviceMinor:70 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:363 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f97e9991-dae4-4dfd-a57e-02842e3097f0/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:410 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/bbbddaea-9907-436b-9b3f-110cdb69f8ee/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:406 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~projected/kube-api-access-qp4f8 DeviceMajor:0 DeviceMinor:291 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:363 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-420 DeviceMajor:0 DeviceMinor:420 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/79bb54aa-20a3-4a69-8215-26b2f006e219/volumes/kubernetes.io~projected/kube-api-access-9jj2n DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~projected/kube-api-access-5j5db DeviceMajor:0 DeviceMinor:237 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7df580b39a397e7b63df91fa2f50d33e196c1b3fd9796aa0764458355017803d/userdata/shm DeviceMajor:0 DeviceMinor:71 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-418 DeviceMajor:0 DeviceMinor:418 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/655998f3-b29e-47f0-9d86-04af9ff2d347/volumes/kubernetes.io~projected/kube-api-access-ssrns DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volumes/kubernetes.io~projected/kube-api-access-dvspl DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:368 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:366 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/508aee9753df7bf44b43b0e0eeb497c529957e6e41afc46ea03988f052a19894/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-341 DeviceMajor:0 DeviceMinor:341 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:364 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/94f39747357fb3ff7dc1a2c090b9bddb1033fbf74adc568c2a2784e874337c29/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:290 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-378 DeviceMajor:0 DeviceMinor:378 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a0f3839c516d560a61fab5f45c5cbeb741ccb57c2b1709a7a9a596361d15440f/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/987589614cee6de4bc3d3d453a94493a2767311b83a1de51c2fd644f7c846e6a/userdata/shm DeviceMajor:0 DeviceMinor:100 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-249 DeviceMajor:0 DeviceMinor:249 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/secret-metrics-server-tls DeviceMajor:0 DeviceMinor:324 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c8549705-e856-4420-9185-66dc04edac7e/volumes/kubernetes.io~projected/kube-api-access-v9klr DeviceMajor:0 DeviceMinor:411 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/80f71f2d-d8d2-4097-a190-b52b04d11212/volumes/kubernetes.io~projected/kube-api-access-z4z6s DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:239 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:287 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-329 DeviceMajor:0 DeviceMinor:329 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7ca009a30373e215a4e8022c6cff728de77c9e4a3303560fd731d30d96c068ba/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~projected/kube-api-access-gjxsr DeviceMajor:0 DeviceMinor:231 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~projected/kube-api-access-fgxsn DeviceMajor:0 DeviceMinor:240 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2ca48acc-d5eb-434b-b8a3-e77928817c78/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/ef2d1228-d6dd-4398-8c36-4be128ee0e62/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:289 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/client-ca-bundle DeviceMajor:0 DeviceMinor:326 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-396 DeviceMajor:0 DeviceMinor:396 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~projected/kube-api-access-fpxwh DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0456d95ec2f885206ec78820e214d959ad2296edb3ae1f97112852ac0d253dba/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:285 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:371 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-391 DeviceMajor:0 DeviceMinor:391 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/015e2f291580da1e741ebb73ca8a00fc43daa2953a57844961888b7f1cf0a3c5/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:369 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:235 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eaf31df20fb67307a013bd23470a09c985eb5278d5953ad594ebba9385515a62/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c794bb969f40e01cca603be427ddf4b923c994bf4f3ab065d60eceeb74800291/userdata/shm DeviceMajor:0 DeviceMinor:414 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9107266c-733c-4bcd-8c8c-679ac2d5186f/volumes/kubernetes.io~projected/kube-api-access-m4wwf DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-245 DeviceMajor:0 DeviceMinor:245 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:273 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-351 DeviceMajor:0 DeviceMinor:351 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:236 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-401 DeviceMajor:0 DeviceMinor:401 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/3696b0b9-b3d7-479f-be52-853834548a9a/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/86ad50c1-15f0-4411-ad5e-5462a40601e7/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b279a7055800642eb2bd798580ba47f00532c509fadfc4263463baa03c914328/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f9017cbf-6684-4052-a42c-d48f05c21961/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~projected/kube-api-access-jtfj4 DeviceMajor:0 DeviceMinor:319 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e7139412634f24118ab2ba9c463fd0d30f0599ff6627cc044e609e4f3704d0d/userdata/shm DeviceMajor:0 DeviceMinor:412 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/220a4d4c74795d4a36b6a1812879cd1948c227d758d2dda3daa5c89a2322efcd/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/abe9e215d64722c0200f64860d1f6c1f966755345b0864abec747549eab1c2b2/userdata/shm DeviceMajor:0 DeviceMinor:96 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f9017cbf-6684-4052-a42c-d48f05c21961/volumes/kubernetes.io~projected/kube-api-access-lgcdb DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52a1be501be18d391075ae26e0207468daac80b20c80225eae0bc1bbb9c3a4e5/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2da3399e-5270-4bde-82e2-f9743a281797/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:283 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-339 DeviceMajor:0 DeviceMinor:339 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:365 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69/userdata/shm DeviceMajor:0 DeviceMinor:374 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d925d9a8-26ee-448e-bc33-007661c3414a/volumes/kubernetes.io~projected/kube-api-access-lg9fw DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-68 DeviceMajor:0 DeviceMinor:68 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-98 DeviceMajor:0 DeviceMinor:98 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:225 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/270efdc7-7967-4f7d-b4f6-b37bc80716e8/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:238 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:286 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:290 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~projected/kube-api-access-n7h2s DeviceMajor:0 DeviceMinor:373 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-386 DeviceMajor:0 DeviceMinor:386 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6/userdata/shm DeviceMajor:0 DeviceMinor:227 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:372 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:226 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:367 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:370 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:363 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b2dce7a8-100f-44e1-8409-42b42eef282f/volumes/kubernetes.io~secret/secret-metrics-server-client-certs DeviceMajor:0 DeviceMinor:325 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d079ca7f53e854d39b3e28e3611daacf00afefc7991627156002020d8742a4a3/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:015e2f291580da1 MacAddress:9a:fd:44:1d:96:aa Speed:10000 Mtu:8901} {Name:0456d95ec2f8852 MacAddress:0a:59:e4:65:dc:05 Speed:10000 Mtu:8901} {Name:0e7139412634f24 MacAddress:f6:ef:1b:f2:ae:30 Speed:10000 Mtu:8901} {Name:5118293cb60e8da MacAddress:7e:c3:cd:06:00:1b Speed:10000 Mtu:8901} {Name:52a1be501be18d3 MacAddress:d2:d8:50:62:71:c6 Speed:10000 Mtu:8901} {Name:6df7d4e0bca6adf MacAddress:4e:85:9d:27:5d:81 Speed:10000 Mtu:8901} {Name:751273d012f5e52 MacAddress:26:1e:a6:e1:c7:63 Speed:10000 Mtu:8901} {Name:b279a7055800642 MacAddress:12:b9:f8:24:46:27 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f2:4d:af:65 Speed:0 Mtu:9001} {Name:br-int MacAddress:1e:2c:e5:ed:8d:cd Speed:0 Mtu:8901} {Name:c794bb969f40e01 MacAddress:0a:5d:be:10:64:f7 Speed:10000 Mtu:8901} {Name:d079ca7f53e854d MacAddress:1a:7a:21:1a:2f:4b Speed:10000 Mtu:8901} {Name:eaf31df20fb6730 MacAddress:7e:25:99:0f:eb:37 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f2:4d:af:65 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:5e:93:50:04:31:51 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:ce:44:54:d8:9d:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.897911 6133 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.897949 6133 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898158 6133 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898173 6133 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898316 6133 topology_manager.go:143] "Creating topology manager with none policy" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898323 6133 container_manager_linux.go:311] "Creating device plugin manager" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898332 6133 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898350 6133 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898421 6133 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898567 6133 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898670 6133 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898703 6133 kubelet.go:493] "Attempting to sync node with API server" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898716 6133 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898726 6133 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898734 6133 kubelet.go:405] "Adding apiserver pod source" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.898744 6133 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.899313 6133 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.899322 6133 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:14:03.901747 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.899720 6133 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 29 23:14:03.903725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.903708 6133 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 29 23:14:03.903725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.903724 6133 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 29 23:14:03.903821 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.903813 6133 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 29 23:14:03.903992 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.903980 6133 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 29 23:14:03.904025 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904010 6133 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 29 23:14:03.904102 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904093 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 29 23:14:03.904132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904107 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 29 23:14:03.904132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904113 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 29 23:14:03.904132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904118 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 29 23:14:03.904132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904123 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 29 23:14:03.904132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904129 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904135 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904140 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904147 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904152 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904160 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904170 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904192 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 29 23:14:03.904348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.904197 6133 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 29 23:14:03.907268 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.907254 6133 server.go:1263] "Started kubelet" Oct 29 23:14:03.907439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.907360 6133 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 29 23:14:03.907492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.907414 6133 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 29 23:14:03.907492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.907472 6133 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 29 23:14:03.907774 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.907752 6133 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 29 23:14:03.908348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.908334 6133 server.go:317] "Adding debug handlers to kubelet server" Oct 29 23:14:03.908589 ip-10-0-143-10 systemd[1]: Started Kubernetes Kubelet. Oct 29 23:14:03.910539 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910524 6133 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910675 6133 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910715 6133 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910728 6133 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910729 6133 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:54 +0000 UTC" deadline="2028-07-26 18:09:32.249713552 +0000 UTC" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910757 6133 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15258h55m28.338959866s" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:03.910783 6133 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Oct 29 23:14:03.913308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.910829 6133 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 29 23:14:03.914589 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914550 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9107266c-733c-4bcd-8c8c-679ac2d5186f" volumeName="kubernetes.io/projected/9107266c-733c-4bcd-8c8c-679ac2d5186f-kube-api-access-m4wwf" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914590 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914606 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914616 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914628 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914636 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914644 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914657 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914667 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914677 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef2d1228-d6dd-4398-8c36-4be128ee0e62" volumeName="kubernetes.io/secret/ef2d1228-d6dd-4398-8c36-4be128ee0e62-insights-runtime-extractor-tls" seLinuxMountContext="" Oct 29 23:14:03.914684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914685 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f71f2d-d8d2-4097-a190-b52b04d11212" volumeName="kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-sysctl-allowlist" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914698 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914706 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914714 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914727 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef2d1228-d6dd-4398-8c36-4be128ee0e62" volumeName="kubernetes.io/projected/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-api-access-8s6cp" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914735 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914746 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914754 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9017cbf-6684-4052-a42c-d48f05c21961" volumeName="kubernetes.io/empty-dir/f9017cbf-6684-4052-a42c-d48f05c21961-tmp-dir" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914764 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3aa46c84-d4da-4894-83f5-bfe0bb886c42" volumeName="kubernetes.io/configmap/3aa46c84-d4da-4894-83f5-bfe0bb886c42-serviceca" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914773 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86ad50c1-15f0-4411-ad5e-5462a40601e7" volumeName="kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-tmp" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914780 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914828 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914836 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86ad50c1-15f0-4411-ad5e-5462a40601e7" volumeName="kubernetes.io/projected/86ad50c1-15f0-4411-ad5e-5462a40601e7-kube-api-access-fpxwh" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914847 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914855 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f71f2d-d8d2-4097-a190-b52b04d11212" volumeName="kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-binary-copy" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914863 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2" volumeName="kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-tls" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914928 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3aa46c84-d4da-4894-83f5-bfe0bb886c42" volumeName="kubernetes.io/projected/3aa46c84-d4da-4894-83f5-bfe0bb886c42-kube-api-access-8t42k" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914937 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bbbddaea-9907-436b-9b3f-110cdb69f8ee" volumeName="kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914951 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d925d9a8-26ee-448e-bc33-007661c3414a" volumeName="kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-cni-binary-copy" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914985 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca48acc-d5eb-434b-b8a3-e77928817c78" volumeName="kubernetes.io/projected/2ca48acc-d5eb-434b-b8a3-e77928817c78-kube-api-access-dvspl" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.914992 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3696b0b9-b3d7-479f-be52-853834548a9a" volumeName="kubernetes.io/configmap/3696b0b9-b3d7-479f-be52-853834548a9a-konnectivity-ca" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915003 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915014 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915022 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef2d1228-d6dd-4398-8c36-4be128ee0e62" volumeName="kubernetes.io/empty-dir/ef2d1228-d6dd-4398-8c36-4be128ee0e62-data-volume" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915051 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9017cbf-6684-4052-a42c-d48f05c21961" volumeName="kubernetes.io/configmap/f9017cbf-6684-4052-a42c-d48f05c21961-config-volume" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915059 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915066 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915106 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/empty-dir/b2dce7a8-100f-44e1-8409-42b42eef282f-audit-log" seLinuxMountContext="" Oct 29 23:14:03.915131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915116 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-client-ca-bundle" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915156 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef2d1228-d6dd-4398-8c36-4be128ee0e62" volumeName="kubernetes.io/configmap/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915164 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="270efdc7-7967-4f7d-b4f6-b37bc80716e8" volumeName="kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-tls" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915172 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2da3399e-5270-4bde-82e2-f9743a281797" volumeName="kubernetes.io/secret/2da3399e-5270-4bde-82e2-f9743a281797-cert" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915182 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86ad50c1-15f0-4411-ad5e-5462a40601e7" volumeName="kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-tuned" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915226 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915236 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-tls" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915243 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bbbddaea-9907-436b-9b3f-110cdb69f8ee" volumeName="kubernetes.io/projected/bbbddaea-9907-436b-9b3f-110cdb69f8ee-kube-api-access-fq27d" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915251 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f71f2d-d8d2-4097-a190-b52b04d11212" volumeName="kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915261 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="270efdc7-7967-4f7d-b4f6-b37bc80716e8" volumeName="kubernetes.io/empty-dir/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-textfile" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915392 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915405 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915412 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915420 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915429 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9017cbf-6684-4052-a42c-d48f05c21961" volumeName="kubernetes.io/projected/f9017cbf-6684-4052-a42c-d48f05c21961-kube-api-access-lgcdb" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915438 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915449 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="270efdc7-7967-4f7d-b4f6-b37bc80716e8" volumeName="kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-accelerators-collector-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915457 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="270efdc7-7967-4f7d-b4f6-b37bc80716e8" volumeName="kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-metrics-client-ca" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915498 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2" volumeName="kubernetes.io/configmap/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-metrics-client-ca" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915508 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2" volumeName="kubernetes.io/projected/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-kube-api-access-5j5db" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915515 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2" volumeName="kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915529 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915541 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915553 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca48acc-d5eb-434b-b8a3-e77928817c78" volumeName="kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915567 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3696b0b9-b3d7-479f-be52-853834548a9a" volumeName="kubernetes.io/secret/3696b0b9-b3d7-479f-be52-853834548a9a-agent-certs" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915575 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="655998f3-b29e-47f0-9d86-04af9ff2d347" volumeName="kubernetes.io/projected/655998f3-b29e-47f0-9d86-04af9ff2d347-kube-api-access-ssrns" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915589 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915601 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915612 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915623 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915631 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915644 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca48acc-d5eb-434b-b8a3-e77928817c78" volumeName="kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-env-overrides" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915654 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="80f71f2d-d8d2-4097-a190-b52b04d11212" volumeName="kubernetes.io/projected/80f71f2d-d8d2-4097-a190-b52b04d11212-kube-api-access-z4z6s" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915662 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" volumeName="kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915673 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-metrics-server-audit-profiles" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915681 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-client-certs" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915690 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915699 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915708 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d925d9a8-26ee-448e-bc33-007661c3414a" volumeName="kubernetes.io/projected/d925d9a8-26ee-448e-bc33-007661c3414a-kube-api-access-lg9fw" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915722 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="270efdc7-7967-4f7d-b4f6-b37bc80716e8" volumeName="kubernetes.io/projected/270efdc7-7967-4f7d-b4f6-b37bc80716e8-kube-api-access-fgxsn" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915730 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="270efdc7-7967-4f7d-b4f6-b37bc80716e8" volumeName="kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-kube-rbac-proxy-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915741 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca48acc-d5eb-434b-b8a3-e77928817c78" volumeName="kubernetes.io/secret/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovn-node-metrics-cert" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915749 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2da3399e-5270-4bde-82e2-f9743a281797" volumeName="kubernetes.io/projected/2da3399e-5270-4bde-82e2-f9743a281797-kube-api-access-7d2hp" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915757 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79bb54aa-20a3-4a69-8215-26b2f006e219" volumeName="kubernetes.io/projected/79bb54aa-20a3-4a69-8215-26b2f006e219-kube-api-access-9jj2n" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915768 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915777 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915791 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d925d9a8-26ee-448e-bc33-007661c3414a" volumeName="kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-multus-daemon-config" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915799 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-configmap-kubelet-serving-ca-bundle" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915806 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9f3b524-a270-4a87-b1ab-6ce40cafc122" volumeName="kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915817 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c8549705-e856-4420-9185-66dc04edac7e" volumeName="kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915824 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f9017cbf-6684-4052-a42c-d48f05c21961" volumeName="kubernetes.io/secret/f9017cbf-6684-4052-a42c-d48f05c21961-metrics-tls" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915837 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f97e9991-dae4-4dfd-a57e-02842e3097f0" volumeName="kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915848 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ca48acc-d5eb-434b-b8a3-e77928817c78" volumeName="kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-script-lib" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915856 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" volumeName="kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915866 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b2dce7a8-100f-44e1-8409-42b42eef282f" volumeName="kubernetes.io/projected/b2dce7a8-100f-44e1-8409-42b42eef282f-kube-api-access-jtfj4" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915873 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="655998f3-b29e-47f0-9d86-04af9ff2d347" volumeName="kubernetes.io/empty-dir/655998f3-b29e-47f0-9d86-04af9ff2d347-tmp-dir" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915883 6133 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79bb54aa-20a3-4a69-8215-26b2f006e219" volumeName="kubernetes.io/configmap/79bb54aa-20a3-4a69-8215-26b2f006e219-iptables-alerter-script" seLinuxMountContext="" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915894 6133 reconstruct.go:97] "Volume reconstruction finished" Oct 29 23:14:03.916204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.915901 6133 reconciler.go:29] "Reconciler: start to sync state" Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.916976 6133 factory.go:153] Registering CRI-O factory Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.916991 6133 factory.go:223] Registration of the crio container factory successfully Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.917041 6133 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.917052 6133 factory.go:55] Registering systemd factory Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.917060 6133 factory.go:223] Registration of the systemd container factory successfully Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.917077 6133 factory.go:103] Registering Raw factory Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.917097 6133 manager.go:1199] Started watching for new ooms in manager Oct 29 23:14:03.918763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.917536 6133 manager.go:319] Starting recovery of all containers Oct 29 23:14:03.943598 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.943573 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:14:03.945593 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.945561 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:14:03.948433 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.948385 6133 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 29 23:14:03.949943 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.949921 6133 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 29 23:14:03.950028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.949948 6133 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 29 23:14:03.950028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.949966 6133 kubelet.go:2521] "Starting kubelet main sync loop" Oct 29 23:14:03.950028 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:03.950010 6133 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 29 23:14:03.959027 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.959006 6133 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 29 23:14:03.960737 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.960711 6133 generic.go:356] "Generic (PLEG): container finished" podID="8ca642e2900464b7ec6ed2498b328dcb" containerID="0ebebd41296a1e0e2eeb068c9508aa40d8c5857fe88844cd472e3175249566ef" exitCode=0 Oct 29 23:14:03.961546 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.961521 6133 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:14:03.964397 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.964370 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b" exitCode=0 Oct 29 23:14:03.966758 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.966735 6133 generic.go:356] "Generic (PLEG): container finished" podID="270efdc7-7967-4f7d-b4f6-b37bc80716e8" containerID="2cfb090a94519199218db27380a247365c559a9b0064ce64adc59687a9fd71c1" exitCode=0 Oct 29 23:14:03.970759 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.970729 6133 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:14:03.981632 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.981612 6133 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:14:03.982146 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.982128 6133 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 29 23:14:03.988980 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.988961 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" exitCode=0 Oct 29 23:14:03.999158 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.999137 6133 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="c139543cd9d53ba08b806d9b09c24acec64d227f57b6be6ba035783c96d54494" exitCode=0 Oct 29 23:14:03.999158 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.999157 6133 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="faf58072d348eb6c3ae33f3c467d111b7160de821e9622165b83bf40aef46d86" exitCode=0 Oct 29 23:14:03.999269 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.999163 6133 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="89464ede479447677f1d37f8200d95851affd33cbdc2f4a071510b51621e4daa" exitCode=0 Oct 29 23:14:03.999269 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.999171 6133 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="fd75ad1e3fc092aaad68703adb0c5b7098f70d101b9d8ea5ed3bf24ac034834d" exitCode=0 Oct 29 23:14:03.999269 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.999178 6133 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="9f161a22783bed13586dc07c2529eb2fe8e3b3d17c40b14972161ebf3aed4a69" exitCode=0 Oct 29 23:14:03.999269 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:03.999185 6133 generic.go:356] "Generic (PLEG): container finished" podID="80f71f2d-d8d2-4097-a190-b52b04d11212" containerID="837e906eab4ff6e8623229a6af7d836e0ce38a4b25e76e01702c516b99ee7a2d" exitCode=0 Oct 29 23:14:04.002568 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.002551 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:14:04.002915 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.002896 6133 generic.go:356] "Generic (PLEG): container finished" podID="2ca48acc-d5eb-434b-b8a3-e77928817c78" containerID="47985fa9dde12173334be3d4f219eb73bd79cc772ed55634ba775678bb16d5f2" exitCode=1 Oct 29 23:14:04.021897 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.021878 6133 manager.go:324] Recovery completed Oct 29 23:14:04.045583 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045535 6133 cpu_manager.go:226] "Starting" policy="none" Oct 29 23:14:04.045583 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045548 6133 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 29 23:14:04.045583 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045564 6133 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 29 23:14:04.045708 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045668 6133 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 29 23:14:04.045708 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045677 6133 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 29 23:14:04.045708 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045693 6133 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 29 23:14:04.045708 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045699 6133 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 29 23:14:04.045708 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045703 6133 policy_none.go:50] "Start" Oct 29 23:14:04.045838 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045712 6133 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 29 23:14:04.045838 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045724 6133 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 29 23:14:04.045889 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045872 6133 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 29 23:14:04.045889 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045880 6133 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 29 23:14:04.045889 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.045885 6133 policy_none.go:44] "Start" Oct 29 23:14:04.050147 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:04.050128 6133 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Oct 29 23:14:04.050271 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.050233 6133 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 29 23:14:04.055199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.055186 6133 manager.go:341] "Starting Device Plugin manager" Oct 29 23:14:04.055727 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:04.055211 6133 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 29 23:14:04.055792 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.055729 6133 server.go:87] "Starting device plugin registration server" Oct 29 23:14:04.055979 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.055969 6133 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 29 23:14:04.056009 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.055980 6133 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 29 23:14:04.056104 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.056086 6133 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 29 23:14:04.056209 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.056179 6133 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 29 23:14:04.056275 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.056218 6133 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 29 23:14:04.056275 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.056225 6133 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 29 23:14:04.056398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.056274 6133 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:14:04.056208148Z","UUID":"9f9c6599-15a8-400f-b23e-8709802cf7b4","Handler":null,"Name":"","Endpoint":""} Oct 29 23:14:04.057524 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.057509 6133 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 29 23:14:04.057614 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.057529 6133 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 29 23:14:04.058026 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:04.057934 6133 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 29 23:14:04.156641 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.156623 6133 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 29 23:14:04.158527 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.158506 6133 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Oct 29 23:14:04.158597 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.158535 6133 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Oct 29 23:14:04.158597 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.158548 6133 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Oct 29 23:14:04.158597 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.158586 6133 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.204529 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.204505 6133 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.204598 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.204566 6133 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.250643 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.250607 6133 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal"] Oct 29 23:14:04.251118 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251092 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"8ca642e2900464b7ec6ed2498b328dcb","Type":"ContainerStarted","Data":"c67e0f166d22711404e372d6fa79fc86d65158abd18a925e00f606dd805c0007"} Oct 29 23:14:04.251179 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251126 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"8ca642e2900464b7ec6ed2498b328dcb","Type":"ContainerDied","Data":"0ebebd41296a1e0e2eeb068c9508aa40d8c5857fe88844cd472e3175249566ef"} Oct 29 23:14:04.251179 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251147 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"8ca642e2900464b7ec6ed2498b328dcb","Type":"ContainerStarted","Data":"cb587355ded6ebe521ab135de27b5f5b67b82310d683b3ece7afb9c7efb4a477"} Oct 29 23:14:04.251246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251203 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" event={"ID":"cb762aa62d1c58eba273642f34f2f74a","Type":"ContainerStarted","Data":"418148f7bf3425bc30f6071b2a45777ee4dcc517a92d005c9bac9371f1fe9314"} Oct 29 23:14:04.251246 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251230 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" event={"ID":"cb762aa62d1c58eba273642f34f2f74a","Type":"ContainerStarted","Data":"77ed267aa6eabd5d344de13803bc456fed49009410659db15c9b972bdddf43c3"} Oct 29 23:14:04.251351 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251272 6133 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.251395 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.251383 6133 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.277902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.277881 6133 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:14:04.277987 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:04.277922 6133 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.280682 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.280669 6133 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:14:04.280723 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:04.280702 6133 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.360989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.360969 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb762aa62d1c58eba273642f34f2f74a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"cb762aa62d1c58eba273642f34f2f74a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.361063 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.360994 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.361063 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.361012 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.461577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.461554 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb762aa62d1c58eba273642f34f2f74a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"cb762aa62d1c58eba273642f34f2f74a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.461577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.461579 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.461679 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.461596 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.461679 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.461650 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.461750 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.461650 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb762aa62d1c58eba273642f34f2f74a-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"cb762aa62d1c58eba273642f34f2f74a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.461750 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.461681 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ca642e2900464b7ec6ed2498b328dcb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"8ca642e2900464b7ec6ed2498b328dcb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:04.899676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.899649 6133 apiserver.go:52] "Watching apiserver" Oct 29 23:14:04.948816 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.948791 6133 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 29 23:14:04.950920 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.950884 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-ghx8k","openshift-monitoring/metrics-server-66f6cfc57-5f9nh","kube-system/global-pull-secret-syncer-rrcsq","openshift-monitoring/node-exporter-j55lx","openshift-multus/multus-additional-cni-plugins-h667t","openshift-ingress-canary/ingress-canary-lzd9f","openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp","kube-system/konnectivity-agent-kdkfv","kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x5g6d","openshift-dns/dns-default-hsgvx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl","openshift-network-diagnostics/network-check-target-xnstf","openshift-ovn-kubernetes/ovnkube-node-sg8lq","openshift-insights/insights-runtime-extractor-xbqbf","openshift-monitoring/prometheus-k8s-0","openshift-multus/network-metrics-daemon-2cx5t","openshift-console/console-797fcc75d7-bv46z","openshift-image-registry/node-ca-d7pvl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal","openshift-multus/multus-7x2qc","openshift-dns/node-resolver-4qzft","openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:04.967807 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.967786 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.967932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.967917 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.969874 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.969855 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\"" Oct 29 23:14:04.969960 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.969949 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 29 23:14:04.969993 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.969984 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmxkp\"" Oct 29 23:14:04.970131 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.970120 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\"" Oct 29 23:14:04.970199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.970189 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c96z8\"" Oct 29 23:14:04.972929 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.972916 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kxr2\"" Oct 29 23:14:04.974787 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.974770 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 29 23:14:04.974787 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.974783 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 29 23:14:04.974903 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.974838 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.974999 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.974983 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.975441 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975428 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.975473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975430 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.975564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975549 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 29 23:14:04.975593 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975552 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 29 23:14:04.975687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975673 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.975742 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975726 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27bdq\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975736 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975741 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975741 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975764 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975750 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcbr2\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975752 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 29 23:14:04.975790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975780 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4s2ql\"" Oct 29 23:14:04.975974 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975858 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lj8k\"" Oct 29 23:14:04.975974 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975862 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.975974 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.975874 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 29 23:14:04.976657 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.976645 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\"" Oct 29 23:14:04.977092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.977081 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 29 23:14:04.977237 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.977225 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t5hzf\"" Oct 29 23:14:04.977872 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.977855 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nnrj\"" Oct 29 23:14:04.978273 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.978261 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 29 23:14:04.980584 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.980572 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Oct 29 23:14:04.982462 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.982423 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 29 23:14:04.982462 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.982436 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 29 23:14:04.982462 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.982435 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wsr6j\"" Oct 29 23:14:04.982605 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.982443 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h6cnq\"" Oct 29 23:14:04.982605 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.982448 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-984bt\"" Oct 29 23:14:04.983230 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.983216 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crphw\"" Oct 29 23:14:04.984226 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.984211 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 29 23:14:04.992535 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.992517 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 29 23:14:04.994612 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.994596 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 29 23:14:04.994702 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.994685 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Oct 29 23:14:04.994830 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.994810 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 29 23:14:04.994900 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.994843 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 29 23:14:04.994900 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.994879 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 29 23:14:04.995021 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.995009 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.995348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.995334 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.995384 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.995341 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.996358 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.996337 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 29 23:14:04.996431 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.996407 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 29 23:14:04.996478 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.996443 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.996671 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.996653 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.996928 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.996907 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Oct 29 23:14:04.996990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.996930 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 29 23:14:04.997533 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.997515 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 29 23:14:04.997779 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.997749 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.997864 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.997852 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.998949 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.998928 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 29 23:14:04.999018 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999001 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.999089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999076 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.999141 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999130 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 29 23:14:04.999193 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999182 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.999266 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999254 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 29 23:14:04.999332 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999318 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 29 23:14:04.999389 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999378 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 29 23:14:04.999460 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:04.999448 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 29 23:14:05.009982 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.009961 6133 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:05.010106 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.010091 6133 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:05.013076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.013060 6133 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 29 23:14:05.039480 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.039461 6133 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:14:05.039602 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.039512 6133 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Oct 29 23:14:05.040111 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.040096 6133 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 29 23:14:05.040180 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.040132 6133 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Oct 29 23:14:05.065260 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065238 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-socket-dir-parent\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.065377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065265 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb54aa-20a3-4a69-8215-26b2f006e219-host-slash\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.065377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065306 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfj4\" (UniqueName: \"kubernetes.io/projected/b2dce7a8-100f-44e1-8409-42b42eef282f-kube-api-access-jtfj4\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.065491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065372 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.065491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065401 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssrns\" (UniqueName: \"kubernetes.io/projected/655998f3-b29e-47f0-9d86-04af9ff2d347-kube-api-access-ssrns\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.065491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065421 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-run\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.065491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065440 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.065491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065462 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa46c84-d4da-4894-83f5-bfe0bb886c42-host\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065515 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-tuned\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065588 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065616 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065636 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-cnibin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065639 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-tuned\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065652 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-host\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065677 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9017cbf-6684-4052-a42c-d48f05c21961-tmp-dir\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.065733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065715 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065751 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9017cbf-6684-4052-a42c-d48f05c21961-tmp-dir\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065755 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9fw\" (UniqueName: \"kubernetes.io/projected/d925d9a8-26ee-448e-bc33-007661c3414a-kube-api-access-lg9fw\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065769 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065868 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-netns\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065923 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/655998f3-b29e-47f0-9d86-04af9ff2d347-hosts-file\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065956 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jj2n\" (UniqueName: \"kubernetes.io/projected/79bb54aa-20a3-4a69-8215-26b2f006e219-kube-api-access-9jj2n\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065990 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.065997 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066015 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066041 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066062 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066067 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.066108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066085 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.066152 6133 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066163 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-textfile\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066186 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-multus\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.066213 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:05.5661937 +0000 UTC m=+1.727381267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066219 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066244 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066272 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-script-lib\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066248 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-textfile\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066320 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066391 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-systemd-units\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066418 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-dbus\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066452 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9017cbf-6684-4052-a42c-d48f05c21961-metrics-tls\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066483 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066485 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-script-lib\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066515 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s6cp\" (UniqueName: \"kubernetes.io/projected/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-api-access-8s6cp\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066534 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-conf\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066535 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbbddaea-9907-436b-9b3f-110cdb69f8ee-metrics-certs\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066565 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066588 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066673 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-kubelet\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066723 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9017cbf-6684-4052-a42c-d48f05c21961-metrics-tls\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.066739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066738 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-node-log\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066806 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-env-overrides\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066826 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-modprobe-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066841 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3696b0b9-b3d7-479f-be52-853834548a9a-agent-certs\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066856 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef2d1228-d6dd-4398-8c36-4be128ee0e62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066892 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2da3399e-5270-4bde-82e2-f9743a281797-cert\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066920 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066937 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-root\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066953 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.066978 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-bin\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067001 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-env-overrides\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067003 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-systemd\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067042 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067087 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067117 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067144 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wwf\" (UniqueName: \"kubernetes.io/projected/9107266c-733c-4bcd-8c8c-679ac2d5186f-kube-api-access-m4wwf\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067163 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2da3399e-5270-4bde-82e2-f9743a281797-cert\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067167 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef2d1228-d6dd-4398-8c36-4be128ee0e62-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067201 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067219 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067208 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3696b0b9-b3d7-479f-be52-853834548a9a-agent-certs\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067231 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgxsn\" (UniqueName: \"kubernetes.io/projected/270efdc7-7967-4f7d-b4f6-b37bc80716e8-kube-api-access-fgxsn\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067333 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5db\" (UniqueName: \"kubernetes.io/projected/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-kube-api-access-5j5db\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067380 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067398 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-cni-binary-copy\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067417 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-multus-daemon-config\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067433 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067490 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067517 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067544 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-wtmp\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067569 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvspl\" (UniqueName: \"kubernetes.io/projected/2ca48acc-d5eb-434b-b8a3-e77928817c78-kube-api-access-dvspl\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067585 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067613 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-cni-binary-copy\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067630 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d925d9a8-26ee-448e-bc33-007661c3414a-multus-daemon-config\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.067649 6133 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.067704 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:05.567688942 +0000 UTC m=+1.728876517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067723 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-kubernetes\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067752 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2hp\" (UniqueName: \"kubernetes.io/projected/2da3399e-5270-4bde-82e2-f9743a281797-kube-api-access-7d2hp\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067781 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067814 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-sys-fs\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.067839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067857 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-netns\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067883 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-k8s-cni-cncf-io\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067932 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067977 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-multus-certs\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.067986 6133 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.067986 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068027 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-etc-kubernetes\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068034 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068045 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-system-cni-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068081 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.068107 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:05.568091152 +0000 UTC m=+1.729278724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-config" not registered Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068120 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9017cbf-6684-4052-a42c-d48f05c21961-config-volume\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068138 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068154 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-var-lib-kubelet\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068171 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068228 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-metrics-server-audit-profiles\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068240 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068263 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068262 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9017cbf-6684-4052-a42c-d48f05c21961-config-volume\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068315 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068320 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068353 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068379 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-tls\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068405 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068431 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-etc-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068456 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068490 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-config\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068494 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovn-node-metrics-cert\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068526 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpxwh\" (UniqueName: \"kubernetes.io/projected/86ad50c1-15f0-4411-ad5e-5462a40601e7-kube-api-access-fpxwh\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068549 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068554 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068569 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068576 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b2dce7a8-100f-44e1-8409-42b42eef282f-metrics-server-audit-profiles\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068589 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-metrics-client-ca\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068615 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.068622 6133 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068647 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-systemd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068663 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-tls\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.068803 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:05.568769791 +0000 UTC m=+1.729957356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"service-ca" not registered Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068877 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068966 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068982 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f97e9991-dae4-4dfd-a57e-02842e3097f0-original-pull-secret\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.068886 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ca48acc-d5eb-434b-b8a3-e77928817c78-ovnkube-config\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069009 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/270efdc7-7967-4f7d-b4f6-b37bc80716e8-metrics-client-ca\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069031 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069061 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069123 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb54aa-20a3-4a69-8215-26b2f006e219-iptables-alerter-script\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069145 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069239 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069273 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79bb54aa-20a3-4a69-8215-26b2f006e219-iptables-alerter-script\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069265 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t42k\" (UniqueName: \"kubernetes.io/projected/3aa46c84-d4da-4894-83f5-bfe0bb886c42-kube-api-access-8t42k\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069383 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-device-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069408 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069464 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069503 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069535 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-lib-modules\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069565 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-client-certs\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069579 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069587 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2dce7a8-100f-44e1-8409-42b42eef282f-audit-log\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069608 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-client-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069712 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069715 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069754 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-hostroot\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069779 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-conf-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.069773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069810 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-cnibin\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069875 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b2dce7a8-100f-44e1-8409-42b42eef282f-audit-log\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069892 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-log-socket\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069929 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-netd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.069931 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070003 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3aa46c84-d4da-4894-83f5-bfe0bb886c42-serviceca\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070066 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070148 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-sys\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070197 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-system-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070228 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070255 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070302 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070314 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070330 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-kubelet-config\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070357 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-ovn\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070379 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef2d1228-d6dd-4398-8c36-4be128ee0e62-crio-socket\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070402 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070405 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-sys\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070446 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070463 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070504 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070513 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070506 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070557 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070601 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-var-lib-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070650 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq27d\" (UniqueName: \"kubernetes.io/projected/bbbddaea-9907-436b-9b3f-110cdb69f8ee-kube-api-access-fq27d\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070693 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070699 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3aa46c84-d4da-4894-83f5-bfe0bb886c42-serviceca\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.070721 6133 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070755 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysconfig\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070786 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-tmp\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070813 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.070849 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:05.570834015 +0000 UTC m=+1.732021565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070876 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86ad50c1-15f0-4411-ad5e-5462a40601e7-tmp\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070875 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.070970 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071033 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071045 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071134 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071170 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071174 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-binary-copy\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071219 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071277 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4z6s\" (UniqueName: \"kubernetes.io/projected/80f71f2d-d8d2-4097-a190-b52b04d11212-kube-api-access-z4z6s\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071324 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-slash\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071322 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071374 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2d1228-d6dd-4398-8c36-4be128ee0e62-data-volume\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071379 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80f71f2d-d8d2-4097-a190-b52b04d11212-cni-binary-copy\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071408 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgcdb\" (UniqueName: \"kubernetes.io/projected/f9017cbf-6684-4052-a42c-d48f05c21961-kube-api-access-lgcdb\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071435 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071462 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071538 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3696b0b9-b3d7-479f-be52-853834548a9a-konnectivity-ca\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071577 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef2d1228-d6dd-4398-8c36-4be128ee0e62-data-volume\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071586 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655998f3-b29e-47f0-9d86-04af9ff2d347-tmp-dir\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071636 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071640 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071663 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071692 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-registration-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071718 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-kubelet\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071778 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-bin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071801 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/655998f3-b29e-47f0-9d86-04af9ff2d347-tmp-dir\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071831 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-tls\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071849 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071860 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071880 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-socket-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.071863 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3696b0b9-b3d7-479f-be52-853834548a9a-konnectivity-ca\") pod \"konnectivity-agent-kdkfv\" (UID: \"3696b0b9-b3d7-479f-be52-853834548a9a\") " pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072535 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bglshiftfpfve\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072547 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072563 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072640 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 29 23:14:05.072776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072675 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072835 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-94pn2\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072850 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072857 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072875 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6s7px\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072891 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072906 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072927 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072933 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072941 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072946 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072947 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mdhsx\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.072992 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ss9x2\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.073038 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9eulmb5p8ehfg\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.073072 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.073106 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 29 23:14:05.075208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.073166 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 29 23:14:05.076455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.076438 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.076455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.076456 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.076568 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.076466 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.076568 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.076456 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.076568 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.076438 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.077834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.077643 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.077834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.077656 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.077834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.077645 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.077834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.077692 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.077834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.077773 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.078506 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.078208 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.078506 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.078400 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.078506 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.078498 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.079023 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.079005 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.080076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.080059 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-client-ca-bundle\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.080154 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.080107 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-client-certs\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.080197 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.080175 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.081243 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.081223 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.081243 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.081233 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.082387 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.082371 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.082465 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.082396 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b2dce7a8-100f-44e1-8409-42b42eef282f-secret-metrics-server-tls\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.082530 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.082503 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.108884 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.108867 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9fw\" (UniqueName: \"kubernetes.io/projected/d925d9a8-26ee-448e-bc33-007661c3414a-kube-api-access-lg9fw\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.108971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.108916 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t42k\" (UniqueName: \"kubernetes.io/projected/3aa46c84-d4da-4894-83f5-bfe0bb886c42-kube-api-access-8t42k\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.111210 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.111195 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s6cp\" (UniqueName: \"kubernetes.io/projected/ef2d1228-d6dd-4398-8c36-4be128ee0e62-kube-api-access-8s6cp\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.111262 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.111230 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wwf\" (UniqueName: \"kubernetes.io/projected/9107266c-733c-4bcd-8c8c-679ac2d5186f-kube-api-access-m4wwf\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.111262 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.111244 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9klr\" (UniqueName: \"kubernetes.io/projected/c8549705-e856-4420-9185-66dc04edac7e-kube-api-access-v9klr\") pod \"network-check-target-xnstf\" (UID: \"c8549705-e856-4420-9185-66dc04edac7e\") " pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:14:05.112846 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.112830 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5db\" (UniqueName: \"kubernetes.io/projected/3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2-kube-api-access-5j5db\") pod \"openshift-state-metrics-7bd7489957-2cvsp\" (UID: \"3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-2cvsp" Oct 29 23:14:05.116304 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.114565 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2hp\" (UniqueName: \"kubernetes.io/projected/2da3399e-5270-4bde-82e2-f9743a281797-kube-api-access-7d2hp\") pod \"ingress-canary-lzd9f\" (UID: \"2da3399e-5270-4bde-82e2-f9743a281797\") " pod="openshift-ingress-canary/ingress-canary-lzd9f" Oct 29 23:14:05.117893 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.117865 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgxsn\" (UniqueName: \"kubernetes.io/projected/270efdc7-7967-4f7d-b4f6-b37bc80716e8-kube-api-access-fgxsn\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.119437 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.119418 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssrns\" (UniqueName: \"kubernetes.io/projected/655998f3-b29e-47f0-9d86-04af9ff2d347-kube-api-access-ssrns\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.119556 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.119543 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfj4\" (UniqueName: \"kubernetes.io/projected/b2dce7a8-100f-44e1-8409-42b42eef282f-kube-api-access-jtfj4\") pod \"metrics-server-66f6cfc57-5f9nh\" (UID: \"b2dce7a8-100f-44e1-8409-42b42eef282f\") " pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:05.119732 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.119716 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") pod \"prometheus-k8s-0\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:05.120554 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.120535 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvspl\" (UniqueName: \"kubernetes.io/projected/2ca48acc-d5eb-434b-b8a3-e77928817c78-kube-api-access-dvspl\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.120942 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.120923 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jj2n\" (UniqueName: \"kubernetes.io/projected/79bb54aa-20a3-4a69-8215-26b2f006e219-kube-api-access-9jj2n\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.131558 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.131542 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpxwh\" (UniqueName: \"kubernetes.io/projected/86ad50c1-15f0-4411-ad5e-5462a40601e7-kube-api-access-fpxwh\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.135492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.135473 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgcdb\" (UniqueName: \"kubernetes.io/projected/f9017cbf-6684-4052-a42c-d48f05c21961-kube-api-access-lgcdb\") pod \"dns-default-hsgvx\" (UID: \"f9017cbf-6684-4052-a42c-d48f05c21961\") " pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.135492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.135481 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq27d\" (UniqueName: \"kubernetes.io/projected/bbbddaea-9907-436b-9b3f-110cdb69f8ee-kube-api-access-fq27d\") pod \"network-metrics-daemon-2cx5t\" (UID: \"bbbddaea-9907-436b-9b3f-110cdb69f8ee\") " pod="openshift-multus/network-metrics-daemon-2cx5t" Oct 29 23:14:05.135651 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.135636 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") pod \"alertmanager-main-0\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:05.135882 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.135868 6133 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered Oct 29 23:14:05.135926 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.135887 6133 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered Oct 29 23:14:05.135926 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.135901 6133 projected.go:196] Error preparing data for projected volume kube-api-access-gjxsr for pod openshift-console/console-797fcc75d7-bv46z: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:05.135986 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.135970 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:05.635954208 +0000 UTC m=+1.797141759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gjxsr" (UniqueName: "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:05.136200 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.136186 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4z6s\" (UniqueName: \"kubernetes.io/projected/80f71f2d-d8d2-4097-a190-b52b04d11212-kube-api-access-z4z6s\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.172687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172637 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-wtmp\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.172687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172664 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-kubernetes\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.172687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172681 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-sys-fs\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172700 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-netns\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172723 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-k8s-cni-cncf-io\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172754 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-kubernetes\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172764 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-k8s-cni-cncf-io\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172778 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-sys-fs\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172783 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-netns\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172823 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-multus-certs\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172836 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-node-exporter-wtmp\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172846 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-etc-kubernetes\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.172867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172865 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-multus-certs\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172867 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-etc-kubernetes\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172888 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-system-cni-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172911 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-system-cni-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172915 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172943 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-var-lib-kubelet\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172974 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-var-lib-kubelet\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172980 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.172999 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-etc-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173008 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173020 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-systemd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173032 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-etc-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173032 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173040 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173059 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-device-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173063 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-systemd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173068 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-etc-selinux\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173073 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173088 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-lib-modules\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173091 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-device-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173110 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-hostroot\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173110 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-run-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173135 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-hostroot\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173137 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-conf-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173161 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-lib-modules\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173162 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-cnibin\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173161 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-conf-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173189 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-log-socket\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173216 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-netd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173239 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-sys\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173255 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80f71f2d-d8d2-4097-a190-b52b04d11212-cnibin\") pod \"multus-additional-cni-plugins-h667t\" (UID: \"80f71f2d-d8d2-4097-a190-b52b04d11212\") " pod="openshift-multus/multus-additional-cni-plugins-h667t" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173261 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-netd\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173262 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-system-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173261 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-log-socket\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173304 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-sys\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173312 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-kubelet-config\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173337 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-ovn\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173346 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-system-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173360 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-kubelet-config\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.173336 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173363 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef2d1228-d6dd-4398-8c36-4be128ee0e62-crio-socket\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173379 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-ovn\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173383 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-sys\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173419 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-var-lib-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173439 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef2d1228-d6dd-4398-8c36-4be128ee0e62-crio-socket\") pod \"insights-runtime-extractor-xbqbf\" (UID: \"ef2d1228-d6dd-4398-8c36-4be128ee0e62\") " pod="openshift-insights/insights-runtime-extractor-xbqbf" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173442 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysconfig\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173464 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-sys\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173471 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173490 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173491 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysconfig\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173465 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-var-lib-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173506 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-slash\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173522 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-slash\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173545 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-registration-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173564 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-cni-dir\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173569 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-kubelet\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173592 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-bin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173598 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-registration-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173565 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-run-openvswitch\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173618 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-kubelet\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173618 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173633 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-bin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173647 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-socket-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173663 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-socket-dir-parent\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173668 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173678 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb54aa-20a3-4a69-8215-26b2f006e219-host-slash\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173694 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-run\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173707 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa46c84-d4da-4894-83f5-bfe0bb886c42-host\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173720 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-cnibin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173730 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-multus-socket-dir-parent\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173740 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-host\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173722 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bb54aa-20a3-4a69-8215-26b2f006e219-host-slash\") pod \"iptables-alerter-ghx8k\" (UID: \"79bb54aa-20a3-4a69-8215-26b2f006e219\") " pod="openshift-network-operator/iptables-alerter-ghx8k" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173756 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-run\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173761 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3aa46c84-d4da-4894-83f5-bfe0bb886c42-host\") pod \"node-ca-d7pvl\" (UID: \"3aa46c84-d4da-4894-83f5-bfe0bb886c42\") " pod="openshift-image-registry/node-ca-d7pvl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173764 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-netns\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173751 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9107266c-733c-4bcd-8c8c-679ac2d5186f-socket-dir\") pod \"aws-ebs-csi-driver-node-m7chl\" (UID: \"9107266c-733c-4bcd-8c8c-679ac2d5186f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m7chl" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173784 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-cnibin\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173787 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/655998f3-b29e-47f0-9d86-04af9ff2d347-hosts-file\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173805 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-run-netns\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173824 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/655998f3-b29e-47f0-9d86-04af9ff2d347-hosts-file\") pod \"node-resolver-4qzft\" (UID: \"655998f3-b29e-47f0-9d86-04af9ff2d347\") " pod="openshift-dns/node-resolver-4qzft" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173843 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-host\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173847 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-multus\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173881 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-cni-multus\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173879 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173914 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173915 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-systemd-units\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173943 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-dbus\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173944 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-systemd-units\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173972 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-conf\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.173981 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f97e9991-dae4-4dfd-a57e-02842e3097f0-dbus\") pod \"global-pull-secret-syncer-rrcsq\" (UID: \"f97e9991-dae4-4dfd-a57e-02842e3097f0\") " pod="kube-system/global-pull-secret-syncer-rrcsq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174018 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-kubelet\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174034 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-node-log\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174049 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-modprobe-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174053 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d925d9a8-26ee-448e-bc33-007661c3414a-host-var-lib-kubelet\") pod \"multus-7x2qc\" (UID: \"d925d9a8-26ee-448e-bc33-007661c3414a\") " pod="openshift-multus/multus-7x2qc" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174076 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-sysctl-conf\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174068 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-root\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174094 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/270efdc7-7967-4f7d-b4f6-b37bc80716e8-root\") pod \"node-exporter-j55lx\" (UID: \"270efdc7-7967-4f7d-b4f6-b37bc80716e8\") " pod="openshift-monitoring/node-exporter-j55lx" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174110 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-bin\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174115 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-node-log\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174147 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ca48acc-d5eb-434b-b8a3-e77928817c78-host-cni-bin\") pod \"ovnkube-node-sg8lq\" (UID: \"2ca48acc-d5eb-434b-b8a3-e77928817c78\") " pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174152 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-modprobe-d\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174162 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-systemd\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.174609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.174190 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/86ad50c1-15f0-4411-ad5e-5462a40601e7-etc-systemd\") pod \"tuned-x5g6d\" (UID: \"86ad50c1-15f0-4411-ad5e-5462a40601e7\") " pod="openshift-cluster-node-tuning-operator/tuned-x5g6d" Oct 29 23:14:05.390572 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.390553 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hsgvx" Oct 29 23:14:05.579002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.578942 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.579002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.578975 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.579002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.579002 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.579047 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579074 6133 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.579098 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579099 6133 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579142 6133 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579127 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:06.579110808 +0000 UTC m=+2.740298378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-config" not registered Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579163 6133 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579174 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:06.579162841 +0000 UTC m=+2.740350392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:05.579198 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579194 6133 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:05.579539 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579197 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:06.579182774 +0000 UTC m=+2.740370338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"service-ca" not registered Oct 29 23:14:05.579539 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579243 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:06.579230584 +0000 UTC m=+2.740418138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:05.579539 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.579254 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:06.579248488 +0000 UTC m=+2.740436036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:05.679450 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:05.679427 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:05.679586 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.679568 6133 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered Oct 29 23:14:05.679648 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.679592 6133 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered Oct 29 23:14:05.679648 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.679606 6133 projected.go:196] Error preparing data for projected volume kube-api-access-gjxsr for pod openshift-console/console-797fcc75d7-bv46z: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:05.679758 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:05.679656 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:06.679641276 +0000 UTC m=+2.840828837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjxsr" (UniqueName: "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:06.587884 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:06.587850 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:06.587884 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:06.587887 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:06.587914 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:06.587941 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:06.587972 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.587975 6133 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.587988 6133 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.587996 6133 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588041 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:08.5880227 +0000 UTC m=+4.749210265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-config" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588050 6133 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588060 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:08.588050708 +0000 UTC m=+4.749238256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"service-ca" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588075 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:08.588066608 +0000 UTC m=+4.749254156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588076 6133 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588090 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:08.588081635 +0000 UTC m=+4.749269188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:06.588254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.588118 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:08.588108101 +0000 UTC m=+4.749295663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:06.688778 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:06.688752 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:06.688913 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.688896 6133 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered Oct 29 23:14:06.688913 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.688912 6133 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered Oct 29 23:14:06.688976 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.688923 6133 projected.go:196] Error preparing data for projected volume kube-api-access-gjxsr for pod openshift-console/console-797fcc75d7-bv46z: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:06.689012 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:06.688976 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:08.688962693 +0000 UTC m=+4.850150263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjxsr" (UniqueName: "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:08.324605 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.324580 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:08.605313 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.605243 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:08.605313 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.605299 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.605326 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.605346 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.605376 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605389 6133 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605439 6133 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605445 6133 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605450 6133 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605471 6133 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:08.605510 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605476 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:12.605457216 +0000 UTC m=+8.766644785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:08.605880 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605537 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:12.6055203 +0000 UTC m=+8.766707861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"service-ca" not registered Oct 29 23:14:08.605880 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605565 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:12.605553898 +0000 UTC m=+8.766741451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:08.605880 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605585 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:12.605575756 +0000 UTC m=+8.766763309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-config" not registered Oct 29 23:14:08.605880 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.605603 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:12.605594897 +0000 UTC m=+8.766782448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:08.705809 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:08.705788 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:08.705942 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.705926 6133 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered Oct 29 23:14:08.706001 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.705945 6133 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered Oct 29 23:14:08.706001 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.705973 6133 projected.go:196] Error preparing data for projected volume kube-api-access-gjxsr for pod openshift-console/console-797fcc75d7-bv46z: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:08.706064 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:08.706011 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:12.706000328 +0000 UTC m=+8.867187893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjxsr" (UniqueName: "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:09.241054 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:09.241024 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:09.241216 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:09.241205 6133 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 29 23:14:09.456775 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:09.456751 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:09.467641 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:09.467618 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66f6cfc57-5f9nh" Oct 29 23:14:11.870455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:11.870418 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:14:12.641254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:12.641218 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:12.641269 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:12.641320 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:12.641348 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:12.641367 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641370 6133 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641405 6133 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:12.641443 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641442 6133 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641453 6133 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641446 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:20.641426137 +0000 UTC m=+16.802613705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"service-ca" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641491 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:20.641479842 +0000 UTC m=+16.802667391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641521 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:20.641505503 +0000 UTC m=+16.802693058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641533 6133 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641540 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:20.641531016 +0000 UTC m=+16.802718564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:12.641655 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.641590 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:20.641581384 +0000 UTC m=+16.802768936 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-config" not registered Oct 29 23:14:12.742220 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:12.742194 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:12.742360 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.742339 6133 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered Oct 29 23:14:12.742360 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.742355 6133 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered Oct 29 23:14:12.742430 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.742366 6133 projected.go:196] Error preparing data for projected volume kube-api-access-gjxsr for pod openshift-console/console-797fcc75d7-bv46z: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:12.742430 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:12.742407 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:20.742394065 +0000 UTC m=+16.903581627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjxsr" (UniqueName: "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:13.447399 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:13.447357 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:14:15.445337 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445248 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:15.445718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445563 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="alertmanager" containerID="cri-o://5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4" gracePeriod=120 Oct 29 23:14:15.445718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445616 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-metric" containerID="cri-o://bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0" gracePeriod=120 Oct 29 23:14:15.445718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445649 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-web" containerID="cri-o://bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4" gracePeriod=120 Oct 29 23:14:15.445718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445671 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy" containerID="cri-o://81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b" gracePeriod=120 Oct 29 23:14:15.445928 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445697 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="config-reloader" containerID="cri-o://fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954" gracePeriod=120 Oct 29 23:14:15.445928 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:15.445686 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="prom-label-proxy" containerID="cri-o://f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c" gracePeriod=120 Oct 29 23:14:16.052997 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.052964 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c" exitCode=0 Oct 29 23:14:16.052997 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.052993 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0" exitCode=0 Oct 29 23:14:16.052997 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053000 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b" exitCode=0 Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053005 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954" exitCode=0 Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053014 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4" exitCode=0 Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053033 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c"} Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053102 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0"} Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053130 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b"} Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053154 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954"} Oct 29 23:14:16.053218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.053178 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4"} Oct 29 23:14:16.649673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.649641 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sg8lq" Oct 29 23:14:16.679565 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.679545 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:16.774990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.774963 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775125 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.774999 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775125 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775022 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775125 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775061 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775125 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775096 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775394 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775135 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775583 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775511 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:16.775583 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775528 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:16.775760 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775678 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775818 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775731 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775868 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775840 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775925 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775889 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775984 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775928 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.775984 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.775978 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.776089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.776047 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") pod \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\" (UID: \"b9f3b524-a270-4a87-b1ab-6ce40cafc122\") " Oct 29 23:14:16.776653 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.776495 6133 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-metrics-client-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.776653 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.776526 6133 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-main-db\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.776990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.776964 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:16.777979 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.777959 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:16.778985 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.778575 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:16.778985 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.778850 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.780635 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.780605 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.780965 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.780937 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.781683 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.781662 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "kube-api-access-qp4f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:16.782627 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.782604 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.784381 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.784357 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.785564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.785528 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.793313 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.793290 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config" pod "b9f3b524-a270-4a87-b1ab-6ce40cafc122" (UID: "b9f3b524-a270-4a87-b1ab-6ce40cafc122"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:16.876943 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876916 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp4f8\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-kube-api-access-qp4f8\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.876943 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876939 6133 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9f3b524-a270-4a87-b1ab-6ce40cafc122-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876949 6133 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-out\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876957 6133 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9f3b524-a270-4a87-b1ab-6ce40cafc122-tls-assets\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876966 6133 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876974 6133 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-config-volume\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876983 6133 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-cluster-tls-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.876992 6133 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.877001 6133 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.877011 6133 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-secret-alertmanager-main-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:16.877089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:16.877019 6133 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9f3b524-a270-4a87-b1ab-6ce40cafc122-web-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:17.059537 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.059477 6133 generic.go:356] "Generic (PLEG): container finished" podID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerID="bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4" exitCode=0 Oct 29 23:14:17.059537 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.059516 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4"} Oct 29 23:14:17.059696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.059559 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.059696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.059568 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9f3b524-a270-4a87-b1ab-6ce40cafc122","Type":"ContainerDied","Data":"015e2f291580da1e741ebb73ca8a00fc43daa2953a57844961888b7f1cf0a3c5"} Oct 29 23:14:17.059696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.059601 6133 scope.go:122] "RemoveContainer" containerID="f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c" Oct 29 23:14:17.068141 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.068125 6133 scope.go:122] "RemoveContainer" containerID="bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0" Oct 29 23:14:17.075023 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.075002 6133 scope.go:122] "RemoveContainer" containerID="81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b" Oct 29 23:14:17.081084 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.081067 6133 scope.go:122] "RemoveContainer" containerID="bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4" Oct 29 23:14:17.087150 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.087131 6133 scope.go:122] "RemoveContainer" containerID="fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954" Oct 29 23:14:17.093139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.093123 6133 scope.go:122] "RemoveContainer" containerID="5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4" Oct 29 23:14:17.101655 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.101641 6133 scope.go:122] "RemoveContainer" containerID="d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b" Oct 29 23:14:17.108152 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108136 6133 scope.go:122] "RemoveContainer" containerID="f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c" Oct 29 23:14:17.108424 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.108404 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c\": container with ID starting with f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c not found: ID does not exist" containerID="f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c" Oct 29 23:14:17.108488 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108432 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c"} err="failed to get container status \"f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c\": rpc error: code = NotFound desc = could not find container \"f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c\": container with ID starting with f7f207ea80db778a6efa4ad9a4822111db8b5b33b62322e88f17583221c29f3c not found: ID does not exist" Oct 29 23:14:17.108488 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108462 6133 scope.go:122] "RemoveContainer" containerID="bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0" Oct 29 23:14:17.108727 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.108712 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0\": container with ID starting with bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0 not found: ID does not exist" containerID="bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0" Oct 29 23:14:17.108778 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108733 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0"} err="failed to get container status \"bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0\": rpc error: code = NotFound desc = could not find container \"bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0\": container with ID starting with bab54382e38d2a16bf456fffe49b97d99c9407d3c914ab9ccb6d4b060bd568e0 not found: ID does not exist" Oct 29 23:14:17.108778 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108749 6133 scope.go:122] "RemoveContainer" containerID="81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b" Oct 29 23:14:17.108963 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.108947 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b\": container with ID starting with 81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b not found: ID does not exist" containerID="81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b" Oct 29 23:14:17.109007 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108966 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b"} err="failed to get container status \"81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b\": rpc error: code = NotFound desc = could not find container \"81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b\": container with ID starting with 81d64e94cac477ef061710340e3355e686c221decb2eafe6c068a0f9b76b1f2b not found: ID does not exist" Oct 29 23:14:17.109007 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.108981 6133 scope.go:122] "RemoveContainer" containerID="bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4" Oct 29 23:14:17.109185 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.109170 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4\": container with ID starting with bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4 not found: ID does not exist" containerID="bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4" Oct 29 23:14:17.109228 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.109188 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4"} err="failed to get container status \"bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4\": rpc error: code = NotFound desc = could not find container \"bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4\": container with ID starting with bc4a76aa3d796699c64c235611aae2f5195113c4f748e67341a7f0839fa6c1d4 not found: ID does not exist" Oct 29 23:14:17.109228 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.109201 6133 scope.go:122] "RemoveContainer" containerID="fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954" Oct 29 23:14:17.109566 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.109548 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954\": container with ID starting with fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954 not found: ID does not exist" containerID="fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954" Oct 29 23:14:17.109642 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.109574 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954"} err="failed to get container status \"fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954\": rpc error: code = NotFound desc = could not find container \"fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954\": container with ID starting with fae6b11f21f78b70d7f01e825a25bf876a06eca6f2f8465c4244910a781d2954 not found: ID does not exist" Oct 29 23:14:17.109642 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.109589 6133 scope.go:122] "RemoveContainer" containerID="5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4" Oct 29 23:14:17.109872 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.109854 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4\": container with ID starting with 5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4 not found: ID does not exist" containerID="5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4" Oct 29 23:14:17.109921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.109876 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4"} err="failed to get container status \"5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4\": rpc error: code = NotFound desc = could not find container \"5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4\": container with ID starting with 5934b4aa691ba39c296f3a89833d7af86e32834029f7bc1b0f3fb63a84e8cdf4 not found: ID does not exist" Oct 29 23:14:17.109921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.109892 6133 scope.go:122] "RemoveContainer" containerID="d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b" Oct 29 23:14:17.110117 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:17.110103 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b\": container with ID starting with d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b not found: ID does not exist" containerID="d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b" Oct 29 23:14:17.110163 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.110118 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b"} err="failed to get container status \"d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b\": rpc error: code = NotFound desc = could not find container \"d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b\": container with ID starting with d4d1e7e4a1b23a4bcbcc768c673a0e763b1d895b399080b75d1e2873d166555b not found: ID does not exist" Oct 29 23:14:17.113794 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.113776 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:17.124872 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.124855 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:17.162655 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162634 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:17.162884 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162872 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="config-reloader" Oct 29 23:14:17.162921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162886 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="config-reloader" Oct 29 23:14:17.162921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162901 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-web" Oct 29 23:14:17.162921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162909 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-web" Oct 29 23:14:17.162921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162921 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="alertmanager" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162926 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="alertmanager" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162937 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-metric" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162942 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-metric" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162951 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162956 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162963 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="init-config-reloader" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162967 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="init-config-reloader" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162987 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="prom-label-proxy" Oct 29 23:14:17.163037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.162992 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="prom-label-proxy" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163049 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="init-config-reloader" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163063 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="prom-label-proxy" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163072 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="config-reloader" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163079 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-web" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163085 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="alertmanager" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163091 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy-metric" Oct 29 23:14:17.163331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.163096 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" containerName="kube-rbac-proxy" Oct 29 23:14:17.166610 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.166594 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.195494 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.195471 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Oct 29 23:14:17.195682 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.195667 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Oct 29 23:14:17.195737 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.195723 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Oct 29 23:14:17.195785 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.195723 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Oct 29 23:14:17.204097 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.204078 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Oct 29 23:14:17.204186 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.204079 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mdhsx\"" Oct 29 23:14:17.204186 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.204107 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Oct 29 23:14:17.204186 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.204109 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Oct 29 23:14:17.204186 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.204119 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Oct 29 23:14:17.206458 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.206444 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Oct 29 23:14:17.212395 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.212377 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:17.280880 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.280850 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281018 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.280885 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281018 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.280911 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/807b5b9e-91d7-4478-bc6f-4e867c35b91d-config-out\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281118 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281052 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281118 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281089 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-config-volume\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281118 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281106 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-web-config\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281179 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281200 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/807b5b9e-91d7-4478-bc6f-4e867c35b91d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281315 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281231 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807b5b9e-91d7-4478-bc6f-4e867c35b91d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281315 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281250 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/807b5b9e-91d7-4478-bc6f-4e867c35b91d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281315 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281308 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281415 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281334 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/807b5b9e-91d7-4478-bc6f-4e867c35b91d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.281415 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.281348 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7ld\" (UniqueName: \"kubernetes.io/projected/807b5b9e-91d7-4478-bc6f-4e867c35b91d-kube-api-access-cs7ld\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382180 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382153 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/807b5b9e-91d7-4478-bc6f-4e867c35b91d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382189 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382205 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/807b5b9e-91d7-4478-bc6f-4e867c35b91d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382219 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7ld\" (UniqueName: \"kubernetes.io/projected/807b5b9e-91d7-4478-bc6f-4e867c35b91d-kube-api-access-cs7ld\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382268 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382322 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382360 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/807b5b9e-91d7-4478-bc6f-4e867c35b91d-config-out\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382429 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382462 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-config-volume\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382481 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-web-config\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382513 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382535 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/807b5b9e-91d7-4478-bc6f-4e867c35b91d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382574 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807b5b9e-91d7-4478-bc6f-4e867c35b91d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.382687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382677 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/807b5b9e-91d7-4478-bc6f-4e867c35b91d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.383021 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.382690 6133 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 29 23:14:17.383492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.383268 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/807b5b9e-91d7-4478-bc6f-4e867c35b91d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.383492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.383421 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/807b5b9e-91d7-4478-bc6f-4e867c35b91d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.385937 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.385897 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/807b5b9e-91d7-4478-bc6f-4e867c35b91d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.385937 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.385905 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.386110 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.385989 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.386110 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.386052 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-web-config\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.386259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.386233 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/807b5b9e-91d7-4478-bc6f-4e867c35b91d-config-out\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.386456 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.386424 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-config-volume\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.386748 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.386731 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.387551 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.387527 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.387615 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.387576 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/807b5b9e-91d7-4478-bc6f-4e867c35b91d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.402259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.402239 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7ld\" (UniqueName: \"kubernetes.io/projected/807b5b9e-91d7-4478-bc6f-4e867c35b91d-kube-api-access-cs7ld\") pod \"alertmanager-main-0\" (UID: \"807b5b9e-91d7-4478-bc6f-4e867c35b91d\") " pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.482219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.482185 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Oct 29 23:14:17.815347 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.815264 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Oct 29 23:14:17.820134 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:17.820107 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807b5b9e_91d7_4478_bc6f_4e867c35b91d.slice/crio-017a71a4fe08ad155eddad7c5932f653a5feb55b7801369e192de9b8c3511a20 WatchSource:0}: Error finding container 017a71a4fe08ad155eddad7c5932f653a5feb55b7801369e192de9b8c3511a20: Status 404 returned error can't find the container with id 017a71a4fe08ad155eddad7c5932f653a5feb55b7801369e192de9b8c3511a20 Oct 29 23:14:17.954813 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:17.954782 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9f3b524-a270-4a87-b1ab-6ce40cafc122" path="/var/lib/kubelet/pods/b9f3b524-a270-4a87-b1ab-6ce40cafc122/volumes" Oct 29 23:14:18.064406 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:18.064382 6133 generic.go:356] "Generic (PLEG): container finished" podID="807b5b9e-91d7-4478-bc6f-4e867c35b91d" containerID="f7b2e1bfa457a022279353ef6120aac795b728e56c87eb1459903fe118b5d80f" exitCode=0 Oct 29 23:14:18.064509 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:18.064472 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerDied","Data":"f7b2e1bfa457a022279353ef6120aac795b728e56c87eb1459903fe118b5d80f"} Oct 29 23:14:18.064567 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:18.064545 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"017a71a4fe08ad155eddad7c5932f653a5feb55b7801369e192de9b8c3511a20"} Oct 29 23:14:19.072320 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.072271 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"4874b9355e5fef9f2d12f3d90e7c5464b080909b6096766b735ef5f4b0ed033c"} Oct 29 23:14:19.072673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.072374 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"1e5e47b71d521a7147a8765db01f656850e2f1ba36e53e3a59709042240448cc"} Oct 29 23:14:19.072673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.072416 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"8c2f06db76bbadaa843fd0408750a25c5f3773c986801fb85c99930a1f24c981"} Oct 29 23:14:19.072673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.072456 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"bcbda04ec7f8c31b5a1988ef7fe48a4f07cfccaddfd4ed05412c8843addd6c40"} Oct 29 23:14:19.072673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.072492 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"762447bc0134dda2a55b8a47dfb70c6b01fec2424abc7332ff450ef3043b9b0a"} Oct 29 23:14:19.072673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.072536 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"807b5b9e-91d7-4478-bc6f-4e867c35b91d","Type":"ContainerStarted","Data":"d2dee933cce93ce4920fe1502edc4b7756082b6f09777f739ef2eb6d9a428cf2"} Oct 29 23:14:19.147213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:19.147169 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.125179178 podStartE2EDuration="2.14715215s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.972972ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:19.143109219 +0000 UTC m=+15.304296788" watchObservedRunningTime="2026-10-29 23:14:19.14715215 +0000 UTC m=+15.308339711" Oct 29 23:14:20.044681 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.044649 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:14:20.045151 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.045032 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="prometheus" containerID="cri-o://2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" gracePeriod=600 Oct 29 23:14:20.045151 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.045095 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="config-reloader" containerID="cri-o://df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" gracePeriod=600 Oct 29 23:14:20.045425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.045117 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" gracePeriod=600 Oct 29 23:14:20.045425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.045135 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-web" containerID="cri-o://7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" gracePeriod=600 Oct 29 23:14:20.045425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.045060 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy" containerID="cri-o://45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" gracePeriod=600 Oct 29 23:14:20.045425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.045140 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="thanos-sidecar" containerID="cri-o://c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" gracePeriod=600 Oct 29 23:14:20.282702 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.282673 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:20.308602 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308550 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308602 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308587 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308768 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308610 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308768 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308642 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308876 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308762 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308876 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308803 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308876 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308837 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.308876 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308866 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308907 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308940 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.308972 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309003 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309020 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309039 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309074 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309467 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309115 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309467 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309160 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309467 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309203 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309467 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309252 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.309691 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.309652 6133 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-metrics-client-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.311239 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.310434 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:20.311239 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.310884 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.311700 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.311621 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.312097 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312064 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.312193 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312120 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "kube-api-access-n7h2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:20.312252 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312190 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.312252 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312187 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.312385 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312337 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.312459 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312433 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.312608 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.312583 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.313139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.313111 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.313216 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.313172 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.313216 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.313205 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.313306 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.313293 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.313450 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.313432 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.314405 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.314388 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:20.321713 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.321695 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:20.410498 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410475 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.410629 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410512 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") pod \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\" (UID: \"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1\") " Oct 29 23:14:20.410691 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410677 6133 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410691 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410688 6133 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410697 6133 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-metrics-client-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410706 6133 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410715 6133 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-grpc-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410723 6133 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-web-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410731 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7h2s\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-kube-api-access-n7h2s\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410739 6133 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-kube-rbac-proxy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410747 6133 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410756 6133 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410765 6133 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410774 6133 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-tls-assets\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410783 6133 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-db\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.410791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410794 6133 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.411166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410803 6133 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.411166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410811 6133 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.411166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410807 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:20.411166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.410821 6133 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.412253 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.412230 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out" pod "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" (UID: "9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:20.511759 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.511736 6133 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.511759 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.511757 6133 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1-config-out\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:20.713525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.713496 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:20.713624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.713543 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:20.713624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.713571 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:20.713624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.713591 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:20.713624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.713615 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713654 6133 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713667 6133 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713683 6133 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713709 6133 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713720 6133 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713718 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:36.713702414 +0000 UTC m=+32.874889961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"service-ca" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713782 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:36.71376534 +0000 UTC m=+32.874952893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"oauth-serving-cert" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713799 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:36.713789354 +0000 UTC m=+32.874976906 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-oauth-config" not registered Oct 29 23:14:20.713814 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713819 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:36.713810888 +0000 UTC m=+32.874998440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-serving-cert" not registered Oct 29 23:14:20.714088 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.713839 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:36.713828882 +0000 UTC m=+32.875016439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : object "openshift-console"/"console-config" not registered Oct 29 23:14:20.814810 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:20.814781 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"console-797fcc75d7-bv46z\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:20.814939 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.814925 6133 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered Oct 29 23:14:20.814989 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.814942 6133 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered Oct 29 23:14:20.814989 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.814951 6133 projected.go:196] Error preparing data for projected volume kube-api-access-gjxsr for pod openshift-console/console-797fcc75d7-bv46z: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:20.815053 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:20.814991 6133 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr podName:9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8 nodeName:}" failed. No retries permitted until 2026-10-29 23:14:36.814977613 +0000 UTC m=+32.976165170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gjxsr" (UniqueName: "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr") pod "console-797fcc75d7-bv46z" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered] Oct 29 23:14:21.082459 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082437 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" exitCode=0 Oct 29 23:14:21.082459 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082456 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" exitCode=0 Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082465 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" exitCode=0 Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082471 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" exitCode=0 Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082488 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" exitCode=0 Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082493 6133 generic.go:356] "Generic (PLEG): container finished" podID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" exitCode=0 Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082524 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082538 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.082619 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082595 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} Oct 29 23:14:21.082951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082627 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} Oct 29 23:14:21.082951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082661 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.082951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082661 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} Oct 29 23:14:21.082951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082761 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} Oct 29 23:14:21.082951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082785 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} Oct 29 23:14:21.082951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.082815 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1","Type":"ContainerDied","Data":"6df7d4e0bca6adf56522d11df192cfc3df2fd68da66ec39fc30664977a76ab69"} Oct 29 23:14:21.090212 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.090037 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.096722 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.096704 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.102931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.102917 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.109319 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.109300 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.115604 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.115589 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.122084 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.122064 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.128338 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.128320 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.128599 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.128579 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.128658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.128606 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} err="failed to get container status \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" Oct 29 23:14:21.128658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.128624 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.128842 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.128828 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.128880 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.128845 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} err="failed to get container status \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" Oct 29 23:14:21.128880 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.128857 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.129085 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.129068 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.129117 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129091 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} err="failed to get container status \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" Oct 29 23:14:21.129117 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129102 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.129365 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.129342 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.129449 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129367 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} err="failed to get container status \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" Oct 29 23:14:21.129449 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129378 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.129604 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.129590 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.129651 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129608 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} err="failed to get container status \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" Oct 29 23:14:21.129651 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129619 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.129827 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.129812 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.129875 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129830 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} err="failed to get container status \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" Oct 29 23:14:21.129875 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.129841 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.130037 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:21.130021 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.130071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130041 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} err="failed to get container status \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" Oct 29 23:14:21.130071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130051 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.130225 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130209 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} err="failed to get container status \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" Oct 29 23:14:21.130270 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130224 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.130416 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130400 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} err="failed to get container status \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" Oct 29 23:14:21.130464 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130416 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.130597 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130582 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} err="failed to get container status \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" Oct 29 23:14:21.130637 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130596 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.130796 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130772 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} err="failed to get container status \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" Oct 29 23:14:21.130832 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130798 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.130982 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130966 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} err="failed to get container status \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" Oct 29 23:14:21.131025 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.130982 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.131200 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131185 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} err="failed to get container status \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" Oct 29 23:14:21.131200 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131198 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.131391 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131377 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} err="failed to get container status \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" Oct 29 23:14:21.131391 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131391 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.131572 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131556 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} err="failed to get container status \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" Oct 29 23:14:21.131608 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131571 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.131759 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131744 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} err="failed to get container status \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" Oct 29 23:14:21.131796 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131759 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.131949 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131934 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} err="failed to get container status \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" Oct 29 23:14:21.131989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.131949 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.132114 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132099 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} err="failed to get container status \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" Oct 29 23:14:21.132151 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132114 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.132306 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132291 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} err="failed to get container status \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" Oct 29 23:14:21.132362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132304 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.132488 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132472 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} err="failed to get container status \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" Oct 29 23:14:21.132539 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132487 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.132684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132668 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} err="failed to get container status \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" Oct 29 23:14:21.132724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132685 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.132855 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132840 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} err="failed to get container status \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" Oct 29 23:14:21.132894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.132855 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.133040 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133024 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} err="failed to get container status \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" Oct 29 23:14:21.133082 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133040 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.133214 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133199 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} err="failed to get container status \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" Oct 29 23:14:21.133250 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133215 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.133436 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133421 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} err="failed to get container status \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" Oct 29 23:14:21.133486 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133436 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.133623 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133605 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} err="failed to get container status \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" Oct 29 23:14:21.133660 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133624 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.133792 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133776 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} err="failed to get container status \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" Oct 29 23:14:21.133829 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133792 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.134001 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.133984 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} err="failed to get container status \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" Oct 29 23:14:21.134001 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134000 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.134216 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134200 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} err="failed to get container status \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" Oct 29 23:14:21.134270 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134216 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.134410 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134394 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} err="failed to get container status \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" Oct 29 23:14:21.134446 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134408 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.134635 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134622 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} err="failed to get container status \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" Oct 29 23:14:21.134635 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134635 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.134841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134828 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} err="failed to get container status \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" Oct 29 23:14:21.134841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.134840 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.135040 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135021 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} err="failed to get container status \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" Oct 29 23:14:21.135089 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135040 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.135225 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135207 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} err="failed to get container status \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" Oct 29 23:14:21.135274 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135224 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.135390 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135376 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} err="failed to get container status \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" Oct 29 23:14:21.135445 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135390 6133 scope.go:122] "RemoveContainer" containerID="8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8" Oct 29 23:14:21.135592 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135575 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8"} err="failed to get container status \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": rpc error: code = NotFound desc = could not find container \"8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8\": container with ID starting with 8b2b7d7478832b6d5119fc99a9766af42879b479451322a7d7b150bd9f36bcc8 not found: ID does not exist" Oct 29 23:14:21.135636 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135593 6133 scope.go:122] "RemoveContainer" containerID="45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5" Oct 29 23:14:21.135765 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135751 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5"} err="failed to get container status \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": rpc error: code = NotFound desc = could not find container \"45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5\": container with ID starting with 45f5857b5b9d560cf8e0935dd12394d597411fc794a552d3dae922e21c4b62a5 not found: ID does not exist" Oct 29 23:14:21.135765 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135764 6133 scope.go:122] "RemoveContainer" containerID="7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7" Oct 29 23:14:21.135945 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135929 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7"} err="failed to get container status \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": rpc error: code = NotFound desc = could not find container \"7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7\": container with ID starting with 7dce26cd377335b7db40ada7a24c820a8f001249371afff3e586ef8ac5c91cb7 not found: ID does not exist" Oct 29 23:14:21.135995 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.135945 6133 scope.go:122] "RemoveContainer" containerID="c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f" Oct 29 23:14:21.136128 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136110 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f"} err="failed to get container status \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": rpc error: code = NotFound desc = could not find container \"c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f\": container with ID starting with c6930e820a3fb7118acb1202f64f3b1f83146ea0b3b1613617e70b2145bd6c7f not found: ID does not exist" Oct 29 23:14:21.136165 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136128 6133 scope.go:122] "RemoveContainer" containerID="df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3" Oct 29 23:14:21.136322 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136306 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3"} err="failed to get container status \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": rpc error: code = NotFound desc = could not find container \"df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3\": container with ID starting with df0af070c3b8b675bfd75e9224c78a472f943fac6564fb479a2481612d9240f3 not found: ID does not exist" Oct 29 23:14:21.136361 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136322 6133 scope.go:122] "RemoveContainer" containerID="2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252" Oct 29 23:14:21.136499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136485 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252"} err="failed to get container status \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": rpc error: code = NotFound desc = could not find container \"2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252\": container with ID starting with 2bc9915d0f094168b837d42621e9513da5482a4a2f4f8a17711532d79d658252 not found: ID does not exist" Oct 29 23:14:21.136499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136498 6133 scope.go:122] "RemoveContainer" containerID="449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e" Oct 29 23:14:21.136711 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.136692 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e"} err="failed to get container status \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": rpc error: code = NotFound desc = could not find container \"449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e\": container with ID starting with 449f7af1894d1d18d90f0c3a07e18483bfdf0d245cc0e4877135b2065468347e not found: ID does not exist" Oct 29 23:14:21.147340 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.146319 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:14:21.156078 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.156060 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:14:21.178334 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178163 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:14:21.178511 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178496 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-web" Oct 29 23:14:21.178553 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178513 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-web" Oct 29 23:14:21.178553 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178526 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy" Oct 29 23:14:21.178553 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178532 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy" Oct 29 23:14:21.178553 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178538 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="thanos-sidecar" Oct 29 23:14:21.178553 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178543 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="thanos-sidecar" Oct 29 23:14:21.178553 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178553 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="config-reloader" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178558 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="config-reloader" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178568 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="init-config-reloader" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178573 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="init-config-reloader" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178579 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="prometheus" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178583 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="prometheus" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178593 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-thanos" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178599 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-thanos" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178639 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="prometheus" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178647 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-thanos" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178654 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy-web" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178659 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="kube-rbac-proxy" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178666 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="thanos-sidecar" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178672 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="config-reloader" Oct 29 23:14:21.178724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.178677 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" containerName="init-config-reloader" Oct 29 23:14:21.182188 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.182171 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.198524 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.198495 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Oct 29 23:14:21.198524 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.198517 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Oct 29 23:14:21.198639 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.198508 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Oct 29 23:14:21.199197 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199182 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Oct 29 23:14:21.199503 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199485 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Oct 29 23:14:21.199585 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199572 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Oct 29 23:14:21.199810 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199795 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Oct 29 23:14:21.199841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199830 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Oct 29 23:14:21.199881 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199841 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Oct 29 23:14:21.199881 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199861 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Oct 29 23:14:21.199945 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.199886 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Oct 29 23:14:21.209666 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.209649 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Oct 29 23:14:21.209754 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.209658 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ss9x2\"" Oct 29 23:14:21.210057 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.210040 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bglshiftfpfve\"" Oct 29 23:14:21.211105 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.211084 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Oct 29 23:14:21.211182 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.211138 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Oct 29 23:14:21.216967 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.216948 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217032 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217013 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec301c73-02e5-4cc5-82b9-bdcafee2988b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217035 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217059 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec301c73-02e5-4cc5-82b9-bdcafee2988b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217143 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217111 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217143 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217133 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217245 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217153 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217245 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217213 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217311 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217349 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217446 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217429 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217513 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217467 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217513 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217489 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wllzj\" (UniqueName: \"kubernetes.io/projected/ec301c73-02e5-4cc5-82b9-bdcafee2988b-kube-api-access-wllzj\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217608 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217587 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:14:21.217664 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217602 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217664 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217625 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217767 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217685 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217767 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217714 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217779 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-config\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217800 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.217945 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.217881 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319164 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319193 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319211 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec301c73-02e5-4cc5-82b9-bdcafee2988b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319227 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319252 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec301c73-02e5-4cc5-82b9-bdcafee2988b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319275 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319406 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319446 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319481 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319506 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319532 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319573 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319606 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.319668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319641 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wllzj\" (UniqueName: \"kubernetes.io/projected/ec301c73-02e5-4cc5-82b9-bdcafee2988b-kube-api-access-wllzj\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319699 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319726 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319740 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319752 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319791 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319841 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319849 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-config\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.319896 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.320680 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.320522 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.322814 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.321209 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.322814 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.321839 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.322814 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.322696 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.322814 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.322757 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.322814 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.322811 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-config\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.323451 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.323149 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.323451 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.323410 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec301c73-02e5-4cc5-82b9-bdcafee2988b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.323588 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.323556 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.323640 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.323593 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.323878 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.323854 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec301c73-02e5-4cc5-82b9-bdcafee2988b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.324495 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.324237 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.324495 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.324412 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.324495 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.324457 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.324495 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.324483 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec301c73-02e5-4cc5-82b9-bdcafee2988b-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.325348 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.325331 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.325624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.325604 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec301c73-02e5-4cc5-82b9-bdcafee2988b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.340839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.340819 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wllzj\" (UniqueName: \"kubernetes.io/projected/ec301c73-02e5-4cc5-82b9-bdcafee2988b-kube-api-access-wllzj\") pod \"prometheus-k8s-0\" (UID: \"ec301c73-02e5-4cc5-82b9-bdcafee2988b\") " pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.497829 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.497807 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:21.824803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.824767 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Oct 29 23:14:21.829397 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:14:21.829373 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec301c73_02e5_4cc5_82b9_bdcafee2988b.slice/crio-05fcfa2fdb1b957ef3a7132ce819c208665ff6ac896b53bf41395b70f326da63 WatchSource:0}: Error finding container 05fcfa2fdb1b957ef3a7132ce819c208665ff6ac896b53bf41395b70f326da63: Status 404 returned error can't find the container with id 05fcfa2fdb1b957ef3a7132ce819c208665ff6ac896b53bf41395b70f326da63 Oct 29 23:14:21.955414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:21.955386 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1" path="/var/lib/kubelet/pods/9632aa3b-22b3-4d4a-8fe9-97b2e1551ca1/volumes" Oct 29 23:14:22.087541 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:22.087472 6133 generic.go:356] "Generic (PLEG): container finished" podID="ec301c73-02e5-4cc5-82b9-bdcafee2988b" containerID="cd180bcefda541837a553af309cdc333b096fda3f0b5d136368fe0dabd0e3b54" exitCode=0 Oct 29 23:14:22.087655 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:22.087560 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerDied","Data":"cd180bcefda541837a553af309cdc333b096fda3f0b5d136368fe0dabd0e3b54"} Oct 29 23:14:22.087655 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:22.087649 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"05fcfa2fdb1b957ef3a7132ce819c208665ff6ac896b53bf41395b70f326da63"} Oct 29 23:14:23.094748 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.094710 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"bf3d5678c620fcd507b724d9dd87b16b1d4942195d8264d3e8a2d75343448b4c"} Oct 29 23:14:23.095120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.094824 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"2eb806be73e324e6bad87e64dd10a2fa35be2f907e07f0dc5d6c0cf7b30140f1"} Oct 29 23:14:23.095120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.094867 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"466cc955c8e25304788f38e3576bbead804a46988c0aaf2a418837daf7f49705"} Oct 29 23:14:23.095120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.094901 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"8511adb74309deba4e9602943cbc1fda8d4f0e519aa9f18b4b5f7ab86c03953a"} Oct 29 23:14:23.095120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.094935 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"7d20c3b48f070453a8b2bfdf9f94ef32d3ebd71311daebb26e8856436729688f"} Oct 29 23:14:23.095120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.094975 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec301c73-02e5-4cc5-82b9-bdcafee2988b","Type":"ContainerStarted","Data":"6d0f55eb01700fb210fbb2ddc2203b2068020e0f9a2dd9d82320a0e520e3ac14"} Oct 29 23:14:23.167577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:23.167517 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.151044292 podStartE2EDuration="2.167499665s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.455373ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:14:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:14:23.15614201 +0000 UTC m=+19.317329581" watchObservedRunningTime="2026-10-29 23:14:23.167499665 +0000 UTC m=+19.328687238" Oct 29 23:14:24.696640 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:24.696605 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdkfv" Oct 29 23:14:26.498230 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:26.498200 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:29.976383 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:29.976332 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-797fcc75d7-bv46z" podUID="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" containerName="console" containerID="cri-o://f807fd84571da64b6b88520a03559433f3e99b0cd85db2dddeecc2165088597e" gracePeriod=15 Oct 29 23:14:30.119662 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.119635 6133 generic.go:356] "Generic (PLEG): container finished" podID="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" containerID="f807fd84571da64b6b88520a03559433f3e99b0cd85db2dddeecc2165088597e" exitCode=0 Oct 29 23:14:30.119788 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.119701 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797fcc75d7-bv46z" event={"ID":"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8","Type":"ContainerDied","Data":"f807fd84571da64b6b88520a03559433f3e99b0cd85db2dddeecc2165088597e"} Oct 29 23:14:30.212113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.212091 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:30.305263 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305199 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305262 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305344 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305397 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305579 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305488 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305579 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305530 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305579 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305569 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") pod \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\" (UID: \"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8\") " Oct 29 23:14:30.305735 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305580 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:14:30.305735 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305634 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:30.305912 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305887 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:30.306026 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305890 6133 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:30.306026 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305917 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:14:30.306026 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.305939 6133 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-tmp\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:30.307593 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.307565 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "kube-api-access-gjxsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:14:30.307593 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.307583 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:30.307726 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.307619 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config" pod "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" (UID: "9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:14:30.406370 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.406343 6133 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-oauth-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:30.406370 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.406366 6133 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-console-serving-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:30.406501 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.406380 6133 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-oauth-serving-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:30.406501 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.406393 6133 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-service-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:30.406501 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:30.406407 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjxsr\" (UniqueName: \"kubernetes.io/projected/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8-kube-api-access-gjxsr\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:14:31.124516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:31.124484 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797fcc75d7-bv46z" Oct 29 23:14:31.124964 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:31.124490 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797fcc75d7-bv46z" event={"ID":"9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8","Type":"ContainerDied","Data":"5118293cb60e8da37617824ca0b32aa3a932d75a4009cb721d571819b81dfbf6"} Oct 29 23:14:31.124964 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:31.124614 6133 scope.go:122] "RemoveContainer" containerID="f807fd84571da64b6b88520a03559433f3e99b0cd85db2dddeecc2165088597e" Oct 29 23:14:31.172254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:31.172231 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797fcc75d7-bv46z"] Oct 29 23:14:31.183528 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:31.183506 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797fcc75d7-bv46z"] Oct 29 23:14:31.954311 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:31.954266 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" path="/var/lib/kubelet/pods/9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8/volumes" Oct 29 23:14:39.115636 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:39.115593 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:39.131210 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:39.131185 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:39.170845 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:39.170823 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Oct 29 23:14:41.873574 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:14:41.873541 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xnstf" Oct 29 23:14:43.448195 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:14:43.448156 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:15:13.448417 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:15:13.448382 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:15:43.449254 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:15:43.449209 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:16:13.448490 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:16:13.448447 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:16:43.447644 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:16:43.447614 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:17:04.294019 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.293987 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d"] Oct 29 23:17:04.294499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.294276 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" containerName="console" Oct 29 23:17:04.294499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.294300 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" containerName="console" Oct 29 23:17:04.294499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.294366 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9dc9c65d-e9b4-477e-ba59-0a9001d9b2e8" containerName="console" Oct 29 23:17:04.297064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.297044 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.321888 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.321866 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-cpnnx\"" Oct 29 23:17:04.322094 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.322071 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Oct 29 23:17:04.322208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.322119 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Oct 29 23:17:04.323025 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.323005 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d"] Oct 29 23:17:04.377077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.377053 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.377176 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.377090 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l89z\" (UniqueName: \"kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.377220 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.377180 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.390974 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.390952 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr"] Oct 29 23:17:04.393797 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.393780 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.406947 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.406931 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-ztzvh\"" Oct 29 23:17:04.418982 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.418962 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr"] Oct 29 23:17:04.477424 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477398 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.477554 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477427 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.477554 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477458 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.477554 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477539 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l89z\" (UniqueName: \"kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.477719 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477584 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsh8w\" (UniqueName: \"kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.477719 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477611 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.477827 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477805 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.477883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.477860 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.488224 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.488195 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds"] Oct 29 23:17:04.490757 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.490739 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.498846 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.498824 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l89z\" (UniqueName: \"kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.505163 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.505144 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-pqx8f\"" Oct 29 23:17:04.511161 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.511143 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds"] Oct 29 23:17:04.577942 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.577875 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsh8w\" (UniqueName: \"kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.577942 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.577907 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.577942 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.577931 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.578166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.577949 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.578166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.577966 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.578166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.578043 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89lfq\" (UniqueName: \"kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.578259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.578239 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.578331 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.578313 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.589738 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.589713 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj"] Oct 29 23:17:04.592599 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.592583 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v"] Oct 29 23:17:04.592717 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.592700 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.595106 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.595089 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.598958 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.598939 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsh8w\" (UniqueName: \"kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.606567 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.606550 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-trbqj\"" Oct 29 23:17:04.608836 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.608817 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:04.609102 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.609087 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-wtg5m\"" Oct 29 23:17:04.613413 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.613392 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj"] Oct 29 23:17:04.618646 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.618625 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v"] Oct 29 23:17:04.679438 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679411 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.679572 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679450 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.679572 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679549 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.679705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679589 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.679705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679622 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.679705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679660 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.679853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679702 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89lfq\" (UniqueName: \"kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.679853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679741 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27b4s\" (UniqueName: \"kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.679853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.679805 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qct2f\" (UniqueName: \"kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.680343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.680263 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.680430 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.680416 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.700242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.700218 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89lfq\" (UniqueName: \"kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.706625 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.706608 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:04.780379 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780349 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.780519 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780480 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.780594 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780520 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.780594 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780575 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.780704 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780619 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27b4s\" (UniqueName: \"kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.780704 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780681 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qct2f\" (UniqueName: \"kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.780807 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780789 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.780928 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780905 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.780990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780910 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.780990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.780967 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.799103 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.799081 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27b4s\" (UniqueName: \"kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.799189 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.799084 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qct2f\" (UniqueName: \"kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:04.803917 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.803891 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:04.903793 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.903770 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d"] Oct 29 23:17:04.908228 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:04.908203 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f6d66c_5c19_4138_9af9_e7ae1db97a0d.slice/crio-de84959faf7d9d12c32f03c6b9b89b8b4412ba9dc96b16913b8908c32d1a3d60 WatchSource:0}: Error finding container de84959faf7d9d12c32f03c6b9b89b8b4412ba9dc96b16913b8908c32d1a3d60: Status 404 returned error can't find the container with id de84959faf7d9d12c32f03c6b9b89b8b4412ba9dc96b16913b8908c32d1a3d60 Oct 29 23:17:04.910059 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.910043 6133 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:17:04.923041 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.922971 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:04.929222 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:04.929199 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:05.001432 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.001410 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr"] Oct 29 23:17:05.008158 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:05.008121 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd921d4ec_59bc_46ea_88c2_ab8f7738af12.slice/crio-8ffd8760835d24082de8006d1a997a3e32e02de4b1d063b16298c7d1b6ba7704 WatchSource:0}: Error finding container 8ffd8760835d24082de8006d1a997a3e32e02de4b1d063b16298c7d1b6ba7704: Status 404 returned error can't find the container with id 8ffd8760835d24082de8006d1a997a3e32e02de4b1d063b16298c7d1b6ba7704 Oct 29 23:17:05.091994 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.091963 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds"] Oct 29 23:17:05.096905 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:05.096875 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb75681_3acc_4389_84c6_d25ec8431285.slice/crio-c7ac9751dc40d96926074381d086f4c997678271f8013f1e85a02d907cb7f2cc WatchSource:0}: Error finding container c7ac9751dc40d96926074381d086f4c997678271f8013f1e85a02d907cb7f2cc: Status 404 returned error can't find the container with id c7ac9751dc40d96926074381d086f4c997678271f8013f1e85a02d907cb7f2cc Oct 29 23:17:05.217880 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.217854 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj"] Oct 29 23:17:05.223223 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:05.223194 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5072e1f_295e_4af2_9fea_a47e1111ad45.slice/crio-eff8d30a1cc27e4f12529c48873f8383c05732318694727a6d3e12c513cdbdf9 WatchSource:0}: Error finding container eff8d30a1cc27e4f12529c48873f8383c05732318694727a6d3e12c513cdbdf9: Status 404 returned error can't find the container with id eff8d30a1cc27e4f12529c48873f8383c05732318694727a6d3e12c513cdbdf9 Oct 29 23:17:05.228776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.228756 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v"] Oct 29 23:17:05.233670 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:05.233648 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode114436b_58b9_4801_a0c5_9056cd70f6fe.slice/crio-9cfac13970b54cfffbb9df93d014efde6c5042886077b7767838320f54cf0220 WatchSource:0}: Error finding container 9cfac13970b54cfffbb9df93d014efde6c5042886077b7767838320f54cf0220: Status 404 returned error can't find the container with id 9cfac13970b54cfffbb9df93d014efde6c5042886077b7767838320f54cf0220 Oct 29 23:17:05.637203 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.637097 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" event={"ID":"10f6d66c-5c19-4138-9af9-e7ae1db97a0d","Type":"ContainerStarted","Data":"de84959faf7d9d12c32f03c6b9b89b8b4412ba9dc96b16913b8908c32d1a3d60"} Oct 29 23:17:05.640432 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.640350 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" event={"ID":"e114436b-58b9-4801-a0c5-9056cd70f6fe","Type":"ContainerStarted","Data":"9cfac13970b54cfffbb9df93d014efde6c5042886077b7767838320f54cf0220"} Oct 29 23:17:05.642061 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.641991 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" event={"ID":"bbb75681-3acc-4389-84c6-d25ec8431285","Type":"ContainerStarted","Data":"c7ac9751dc40d96926074381d086f4c997678271f8013f1e85a02d907cb7f2cc"} Oct 29 23:17:05.643756 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.643702 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" event={"ID":"d921d4ec-59bc-46ea-88c2-ab8f7738af12","Type":"ContainerStarted","Data":"8ffd8760835d24082de8006d1a997a3e32e02de4b1d063b16298c7d1b6ba7704"} Oct 29 23:17:05.646518 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:05.646495 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" event={"ID":"c5072e1f-295e-4af2-9fea-a47e1111ad45","Type":"ContainerStarted","Data":"eff8d30a1cc27e4f12529c48873f8383c05732318694727a6d3e12c513cdbdf9"} Oct 29 23:17:06.292912 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.292862 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w"] Oct 29 23:17:06.303591 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.303568 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.316816 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.316608 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w"] Oct 29 23:17:06.326584 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.326559 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-ls8rn\"" Oct 29 23:17:06.499054 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.499017 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.499213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.499079 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.499213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.499138 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnghk\" (UniqueName: \"kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.600721 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.600638 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.600721 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.600715 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnghk\" (UniqueName: \"kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.600967 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.600767 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.601210 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.601186 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.601961 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.601940 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.631224 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.631192 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnghk\" (UniqueName: \"kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:06.928549 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:06.928516 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:07.248899 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:07.248818 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w"] Oct 29 23:17:07.259425 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:07.258446 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48337ed_9a9e_460c_b976_08570fa64e27.slice/crio-4465601500c350c5c4b043f98b07bf2f9c24dcea43d0ca81ad82dbbe1f54330f WatchSource:0}: Error finding container 4465601500c350c5c4b043f98b07bf2f9c24dcea43d0ca81ad82dbbe1f54330f: Status 404 returned error can't find the container with id 4465601500c350c5c4b043f98b07bf2f9c24dcea43d0ca81ad82dbbe1f54330f Oct 29 23:17:07.659417 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:07.659354 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" event={"ID":"e48337ed-9a9e-460c-b976-08570fa64e27","Type":"ContainerStarted","Data":"4465601500c350c5c4b043f98b07bf2f9c24dcea43d0ca81ad82dbbe1f54330f"} Oct 29 23:17:08.441158 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.439627 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9"] Oct 29 23:17:08.454088 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.452922 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.466010 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.465902 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9"] Oct 29 23:17:08.475997 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.475929 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 29 23:17:08.475997 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.475958 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 29 23:17:08.476531 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.476434 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-htpp6\"" Oct 29 23:17:08.476531 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.476499 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516144 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516181 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7t5z\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516229 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516257 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516299 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516328 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516366 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516417 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.516686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.516454 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618318 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618373 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618402 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618426 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618468 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618519 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618547 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618580 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.619343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.618607 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7t5z\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.631661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.620750 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.631661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.621209 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.631661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.621459 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.631661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.622076 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.631661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.622351 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.631661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.630568 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.634795 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.634772 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.645259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.645230 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7t5z\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.650137 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.650095 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-j2mw9\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:08.774808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:08.774733 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:09.014587 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.014554 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw"] Oct 29 23:17:09.020304 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.019732 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.035478 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.035431 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-jz8cd\"" Oct 29 23:17:09.039799 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.039743 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw"] Oct 29 23:17:09.115141 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.115069 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9"] Oct 29 23:17:09.122321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.122275 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4cfz\" (UniqueName: \"kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.122437 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.122354 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.122437 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.122398 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.128037 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:09.128002 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27c1d5c_ee6e_4d18_b33f_f48e2f5f4a19.slice/crio-d7e15c47bfefd6bce25db2031741ef39a678fe1e4a713dc69eaf8c70d3ad5215 WatchSource:0}: Error finding container d7e15c47bfefd6bce25db2031741ef39a678fe1e4a713dc69eaf8c70d3ad5215: Status 404 returned error can't find the container with id d7e15c47bfefd6bce25db2031741ef39a678fe1e4a713dc69eaf8c70d3ad5215 Oct 29 23:17:09.223861 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.223804 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4cfz\" (UniqueName: \"kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.224016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.223877 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.224016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.223921 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.224507 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.224474 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.225187 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.225119 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.248623 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.248575 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4cfz\" (UniqueName: \"kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.341487 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.341418 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:09.681212 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.681117 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" event={"ID":"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19","Type":"ContainerStarted","Data":"d7e15c47bfefd6bce25db2031741ef39a678fe1e4a713dc69eaf8c70d3ad5215"} Oct 29 23:17:09.686003 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:09.685930 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw"] Oct 29 23:17:10.696305 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:10.696191 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" event={"ID":"98c6efb2-7d90-4e60-aa56-884cf7c638c1","Type":"ContainerStarted","Data":"4e6904e48935d5b102e83f6634864894fbbfb8569b8e6f3b2a2f15a2aa25aa55"} Oct 29 23:17:11.707690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.707649 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc"] Oct 29 23:17:11.712148 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.712122 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.740853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.740828 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc"] Oct 29 23:17:11.754680 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.754349 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.754680 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.754398 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.754680 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.754472 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4gqm\" (UniqueName: \"kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.779102 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.779072 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt"] Oct 29 23:17:11.784102 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.783580 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.804944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.804854 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt"] Oct 29 23:17:11.855544 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.855513 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4gqm\" (UniqueName: \"kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.855710 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.855582 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.855710 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.855633 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.855710 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.855661 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.855710 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.855687 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phrkr\" (UniqueName: \"kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.855928 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.855719 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.856148 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.856126 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.856874 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.856850 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.883187 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.883080 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4gqm\" (UniqueName: \"kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:11.958761 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.957589 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.958761 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.957671 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.958761 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.957706 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phrkr\" (UniqueName: \"kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.958761 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.958401 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.958761 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.958648 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:11.994552 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:11.994386 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phrkr\" (UniqueName: \"kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:12.036225 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:12.035996 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:12.104373 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:12.104337 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:12.413117 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:12.413082 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc"] Oct 29 23:17:12.425632 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:12.425602 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0496135_ecec_42dc_9f44_9e57245ed57b.slice/crio-e980228fca0efc1202c8770133c3df80c6c53242ad394db367449ae7c1dc91c0 WatchSource:0}: Error finding container e980228fca0efc1202c8770133c3df80c6c53242ad394db367449ae7c1dc91c0: Status 404 returned error can't find the container with id e980228fca0efc1202c8770133c3df80c6c53242ad394db367449ae7c1dc91c0 Oct 29 23:17:12.463882 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:12.463815 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt"] Oct 29 23:17:12.475707 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:12.475669 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1569848a_a4bc_4f95_a652_d6960d915116.slice/crio-2ba05fa46759fe08c46343554d88ccfdbf3bb2c5a09d394d86cb34d3677b62e9 WatchSource:0}: Error finding container 2ba05fa46759fe08c46343554d88ccfdbf3bb2c5a09d394d86cb34d3677b62e9: Status 404 returned error can't find the container with id 2ba05fa46759fe08c46343554d88ccfdbf3bb2c5a09d394d86cb34d3677b62e9 Oct 29 23:17:12.722625 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:12.722485 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" event={"ID":"1569848a-a4bc-4f95-a652-d6960d915116","Type":"ContainerStarted","Data":"2ba05fa46759fe08c46343554d88ccfdbf3bb2c5a09d394d86cb34d3677b62e9"} Oct 29 23:17:12.726333 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:12.726244 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" event={"ID":"d0496135-ecec-42dc-9f44-9e57245ed57b","Type":"ContainerStarted","Data":"e980228fca0efc1202c8770133c3df80c6c53242ad394db367449ae7c1dc91c0"} Oct 29 23:17:13.484076 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:17:13.484036 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:17:17.587364 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:17.587327 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:17:17.587688 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:17.587412 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:17:17.587688 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:17.587458 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:17:18.798601 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:18.798559 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" event={"ID":"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19","Type":"ContainerStarted","Data":"275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc"} Oct 29 23:17:18.861690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:18.861611 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podStartSLOduration=2.4106142090000002 podStartE2EDuration="10.861592762s" totalImagesPullingTime="8.450978553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:18.850236939 +0000 UTC m=+195.011424510" watchObservedRunningTime="2026-10-29 23:17:18.861592762 +0000 UTC m=+195.022780333" Oct 29 23:17:19.775376 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:19.775343 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:19.782391 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:19.782150 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:19.804439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:19.804416 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:19.805375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:19.805253 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:17:20.815144 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:20.813695 6133 generic.go:356] "Generic (PLEG): container finished" podID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerID="44808f46044a8aa8a4a3f5ddfa7aba6cbb32d8e95cc35ed9cd214a299e8ee0e7" exitCode=0 Oct 29 23:17:20.815144 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:20.814895 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" event={"ID":"10f6d66c-5c19-4138-9af9-e7ae1db97a0d","Type":"ContainerDied","Data":"44808f46044a8aa8a4a3f5ddfa7aba6cbb32d8e95cc35ed9cd214a299e8ee0e7"} Oct 29 23:17:21.819886 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:21.819845 6133 generic.go:356] "Generic (PLEG): container finished" podID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerID="161d61a173be7876f5ff2225dd044e887504d10267fd0ac6ee02eb53cd63e94f" exitCode=0 Oct 29 23:17:21.820360 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:21.819938 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" event={"ID":"d921d4ec-59bc-46ea-88c2-ab8f7738af12","Type":"ContainerDied","Data":"161d61a173be7876f5ff2225dd044e887504d10267fd0ac6ee02eb53cd63e94f"} Oct 29 23:17:21.821792 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:21.821767 6133 generic.go:356] "Generic (PLEG): container finished" podID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerID="9d5addf92d2b33716747b52b1337889ea9ff71c8d91c6d110e246bab3e01d5e1" exitCode=0 Oct 29 23:17:21.821918 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:21.821790 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" event={"ID":"98c6efb2-7d90-4e60-aa56-884cf7c638c1","Type":"ContainerDied","Data":"9d5addf92d2b33716747b52b1337889ea9ff71c8d91c6d110e246bab3e01d5e1"} Oct 29 23:17:21.823436 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:21.823410 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" event={"ID":"e114436b-58b9-4801-a0c5-9056cd70f6fe","Type":"ContainerStarted","Data":"0f32a9f715711dadae784434d53a23ca9c77d6debaa52309c988af478f4682f7"} Oct 29 23:17:22.829931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.829905 6133 generic.go:356] "Generic (PLEG): container finished" podID="1569848a-a4bc-4f95-a652-d6960d915116" containerID="1d3a250e6d1a8b6920e6e9e13fcc10b602fa3485dd581392b8325192a592d50e" exitCode=0 Oct 29 23:17:22.830300 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.829974 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" event={"ID":"1569848a-a4bc-4f95-a652-d6960d915116","Type":"ContainerDied","Data":"1d3a250e6d1a8b6920e6e9e13fcc10b602fa3485dd581392b8325192a592d50e"} Oct 29 23:17:22.831616 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.831587 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" event={"ID":"d0496135-ecec-42dc-9f44-9e57245ed57b","Type":"ContainerStarted","Data":"8b32115ad6483eef33040809e6bc3e7b92f895ba065730408130a880ec576351"} Oct 29 23:17:22.833276 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.833208 6133 generic.go:356] "Generic (PLEG): container finished" podID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerID="57ce904219d094faad9b0b31e85eb4f464245ea65e565c1b98b96bed548d59ac" exitCode=0 Oct 29 23:17:22.833276 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.833309 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" event={"ID":"c5072e1f-295e-4af2-9fea-a47e1111ad45","Type":"ContainerDied","Data":"57ce904219d094faad9b0b31e85eb4f464245ea65e565c1b98b96bed548d59ac"} Oct 29 23:17:22.834839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.834818 6133 generic.go:356] "Generic (PLEG): container finished" podID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerID="0f32a9f715711dadae784434d53a23ca9c77d6debaa52309c988af478f4682f7" exitCode=0 Oct 29 23:17:22.834924 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.834841 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" event={"ID":"e114436b-58b9-4801-a0c5-9056cd70f6fe","Type":"ContainerDied","Data":"0f32a9f715711dadae784434d53a23ca9c77d6debaa52309c988af478f4682f7"} Oct 29 23:17:22.836920 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.836900 6133 generic.go:356] "Generic (PLEG): container finished" podID="bbb75681-3acc-4389-84c6-d25ec8431285" containerID="423520d7ddae9963006b16e5cbb52e7abcdb7c349c9f67231a1b2ca4de8d1533" exitCode=0 Oct 29 23:17:22.836962 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:22.836936 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" event={"ID":"bbb75681-3acc-4389-84c6-d25ec8431285","Type":"ContainerDied","Data":"423520d7ddae9963006b16e5cbb52e7abcdb7c349c9f67231a1b2ca4de8d1533"} Oct 29 23:17:23.845139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.845105 6133 generic.go:356] "Generic (PLEG): container finished" podID="bbb75681-3acc-4389-84c6-d25ec8431285" containerID="e87d92d38f0e2a6699098c2e96727030ebff1ca0bf892fc79b3e1530af8b6bc0" exitCode=0 Oct 29 23:17:23.845565 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.845258 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" event={"ID":"bbb75681-3acc-4389-84c6-d25ec8431285","Type":"ContainerDied","Data":"e87d92d38f0e2a6699098c2e96727030ebff1ca0bf892fc79b3e1530af8b6bc0"} Oct 29 23:17:23.848439 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.848411 6133 generic.go:356] "Generic (PLEG): container finished" podID="1569848a-a4bc-4f95-a652-d6960d915116" containerID="499e165183a337a737a1a2da85d54c45103e18c5eb9b7f60424307a00a613165" exitCode=0 Oct 29 23:17:23.848724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.848656 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" event={"ID":"1569848a-a4bc-4f95-a652-d6960d915116","Type":"ContainerDied","Data":"499e165183a337a737a1a2da85d54c45103e18c5eb9b7f60424307a00a613165"} Oct 29 23:17:23.850989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.850910 6133 generic.go:356] "Generic (PLEG): container finished" podID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerID="8b32115ad6483eef33040809e6bc3e7b92f895ba065730408130a880ec576351" exitCode=0 Oct 29 23:17:23.850989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.850933 6133 generic.go:356] "Generic (PLEG): container finished" podID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerID="227a4fbdc01e770c48ca6ec5b05b6d6cb40a65e2b6e833b38f7ac26e2bb2763d" exitCode=0 Oct 29 23:17:23.851095 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.850996 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" event={"ID":"d0496135-ecec-42dc-9f44-9e57245ed57b","Type":"ContainerDied","Data":"8b32115ad6483eef33040809e6bc3e7b92f895ba065730408130a880ec576351"} Oct 29 23:17:23.851095 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.851035 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" event={"ID":"d0496135-ecec-42dc-9f44-9e57245ed57b","Type":"ContainerDied","Data":"227a4fbdc01e770c48ca6ec5b05b6d6cb40a65e2b6e833b38f7ac26e2bb2763d"} Oct 29 23:17:23.853888 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.853864 6133 generic.go:356] "Generic (PLEG): container finished" podID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerID="f4ce9e8aead9bcbf1eddee95fb2c16a7a302d4e1882bd559c8644c35676898c3" exitCode=0 Oct 29 23:17:23.853989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.853933 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" event={"ID":"d921d4ec-59bc-46ea-88c2-ab8f7738af12","Type":"ContainerDied","Data":"f4ce9e8aead9bcbf1eddee95fb2c16a7a302d4e1882bd559c8644c35676898c3"} Oct 29 23:17:23.856169 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.856146 6133 generic.go:356] "Generic (PLEG): container finished" podID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerID="c4509b0e69ce69e07b462ec6c0d574b93be5df819ade29fa95bb2457382136fe" exitCode=0 Oct 29 23:17:23.856277 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.856213 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" event={"ID":"10f6d66c-5c19-4138-9af9-e7ae1db97a0d","Type":"ContainerDied","Data":"c4509b0e69ce69e07b462ec6c0d574b93be5df819ade29fa95bb2457382136fe"} Oct 29 23:17:23.861398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.859353 6133 generic.go:356] "Generic (PLEG): container finished" podID="e48337ed-9a9e-460c-b976-08570fa64e27" containerID="f98bb4f375be34d08758b8e2df9581836ba317361869abccf71df1e4fea2fa65" exitCode=0 Oct 29 23:17:23.861398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.859437 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" event={"ID":"e48337ed-9a9e-460c-b976-08570fa64e27","Type":"ContainerDied","Data":"f98bb4f375be34d08758b8e2df9581836ba317361869abccf71df1e4fea2fa65"} Oct 29 23:17:23.866408 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.866379 6133 generic.go:356] "Generic (PLEG): container finished" podID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerID="675c9fcc7e2752a76e3e7cbc7a25ee4442a59087e13e0cc54b2645f64b637402" exitCode=0 Oct 29 23:17:23.866559 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:23.866426 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" event={"ID":"e114436b-58b9-4801-a0c5-9056cd70f6fe","Type":"ContainerDied","Data":"675c9fcc7e2752a76e3e7cbc7a25ee4442a59087e13e0cc54b2645f64b637402"} Oct 29 23:17:24.878245 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:24.878207 6133 generic.go:356] "Generic (PLEG): container finished" podID="e48337ed-9a9e-460c-b976-08570fa64e27" containerID="2fde8d81ab2ca39b9a9cf27706c155f9e31bb072fbfa016b5aa692d7d4c5dded" exitCode=0 Oct 29 23:17:24.878712 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:24.878359 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" event={"ID":"e48337ed-9a9e-460c-b976-08570fa64e27","Type":"ContainerDied","Data":"2fde8d81ab2ca39b9a9cf27706c155f9e31bb072fbfa016b5aa692d7d4c5dded"} Oct 29 23:17:25.911665 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:25.911628 6133 generic.go:356] "Generic (PLEG): container finished" podID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerID="8d67d304d3a4a60ef51915d95fc87f44c258085902e02ed8a051f7e07d879ac2" exitCode=0 Oct 29 23:17:25.912176 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:25.911774 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" event={"ID":"98c6efb2-7d90-4e60-aa56-884cf7c638c1","Type":"ContainerDied","Data":"8d67d304d3a4a60ef51915d95fc87f44c258085902e02ed8a051f7e07d879ac2"} Oct 29 23:17:27.954704 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:27.954578 6133 generic.go:356] "Generic (PLEG): container finished" podID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerID="3043d76a00b5a1f7b35d49af1c7485827440ab9bbf3d783c7e6a8c812be54dfd" exitCode=0 Oct 29 23:17:27.966376 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:27.966334 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" event={"ID":"c5072e1f-295e-4af2-9fea-a47e1111ad45","Type":"ContainerDied","Data":"3043d76a00b5a1f7b35d49af1c7485827440ab9bbf3d783c7e6a8c812be54dfd"} Oct 29 23:17:43.113232 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.112714 6133 generic.go:356] "Generic (PLEG): container finished" podID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerID="5c70ae54258d804540a613e8f15955a8debed9931c3f04fd65090bf28d756f34" exitCode=0 Oct 29 23:17:43.113232 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.113150 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" event={"ID":"10f6d66c-5c19-4138-9af9-e7ae1db97a0d","Type":"ContainerDied","Data":"5c70ae54258d804540a613e8f15955a8debed9931c3f04fd65090bf28d756f34"} Oct 29 23:17:43.115983 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.115955 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" event={"ID":"1569848a-a4bc-4f95-a652-d6960d915116","Type":"ContainerStarted","Data":"a87d572436f8608a20e7ed497efb0def0f14e7eec4a901e0d349d00036a98966"} Oct 29 23:17:43.118873 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.118849 6133 generic.go:356] "Generic (PLEG): container finished" podID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerID="8175947697f448783953cd8e47c7f91fde342cc9b06c44cbc43bb7a43655346e" exitCode=0 Oct 29 23:17:43.118977 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.118934 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" event={"ID":"d0496135-ecec-42dc-9f44-9e57245ed57b","Type":"ContainerDied","Data":"8175947697f448783953cd8e47c7f91fde342cc9b06c44cbc43bb7a43655346e"} Oct 29 23:17:43.121605 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.121580 6133 generic.go:356] "Generic (PLEG): container finished" podID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerID="d3025c87555c4591cb098a8346a470878e8684d422c5907759449ba8d773122d" exitCode=0 Oct 29 23:17:43.121684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.121611 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" event={"ID":"d921d4ec-59bc-46ea-88c2-ab8f7738af12","Type":"ContainerDied","Data":"d3025c87555c4591cb098a8346a470878e8684d422c5907759449ba8d773122d"} Oct 29 23:17:43.199614 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:43.199549 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" podStartSLOduration=2.909894528 podStartE2EDuration="32.199529273s" totalImagesPullingTime="29.289634745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:43.196474178 +0000 UTC m=+219.357661749" watchObservedRunningTime="2026-10-29 23:17:43.199529273 +0000 UTC m=+219.360716846" Oct 29 23:17:43.455492 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:17:43.455460 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:17:44.128271 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.128182 6133 generic.go:356] "Generic (PLEG): container finished" podID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerID="980f1172f84c41fc12cea01e0ecbef388c140924deb9f80f0fde355276dfe2b9" exitCode=0 Oct 29 23:17:44.128734 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.128256 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" event={"ID":"e114436b-58b9-4801-a0c5-9056cd70f6fe","Type":"ContainerDied","Data":"980f1172f84c41fc12cea01e0ecbef388c140924deb9f80f0fde355276dfe2b9"} Oct 29 23:17:44.130620 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.130594 6133 generic.go:356] "Generic (PLEG): container finished" podID="bbb75681-3acc-4389-84c6-d25ec8431285" containerID="3d0158d25a85d4f027c1dc7a9706b1e7352d1d0b009844552c737a1ac78478da" exitCode=0 Oct 29 23:17:44.130748 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.130650 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" event={"ID":"bbb75681-3acc-4389-84c6-d25ec8431285","Type":"ContainerDied","Data":"3d0158d25a85d4f027c1dc7a9706b1e7352d1d0b009844552c737a1ac78478da"} Oct 29 23:17:44.133015 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.132964 6133 generic.go:356] "Generic (PLEG): container finished" podID="1569848a-a4bc-4f95-a652-d6960d915116" containerID="a87d572436f8608a20e7ed497efb0def0f14e7eec4a901e0d349d00036a98966" exitCode=0 Oct 29 23:17:44.133160 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.133046 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" event={"ID":"1569848a-a4bc-4f95-a652-d6960d915116","Type":"ContainerDied","Data":"a87d572436f8608a20e7ed497efb0def0f14e7eec4a901e0d349d00036a98966"} Oct 29 23:17:44.135248 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.135223 6133 generic.go:356] "Generic (PLEG): container finished" podID="e48337ed-9a9e-460c-b976-08570fa64e27" containerID="76606e65d46c84eb8d456eddb33c3693935cbfa593ee10c4ce7f6d1c97b09f3d" exitCode=0 Oct 29 23:17:44.135382 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.135312 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" event={"ID":"e48337ed-9a9e-460c-b976-08570fa64e27","Type":"ContainerDied","Data":"76606e65d46c84eb8d456eddb33c3693935cbfa593ee10c4ce7f6d1c97b09f3d"} Oct 29 23:17:44.137492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.137462 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" event={"ID":"98c6efb2-7d90-4e60-aa56-884cf7c638c1","Type":"ContainerStarted","Data":"5d45e17447e6806b7b3d6e8d2f21ed02e0d8f6e00632b4383a9b44476b976445"} Oct 29 23:17:44.248523 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.248469 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" podStartSLOduration=4.122810441 podStartE2EDuration="36.248447931s" totalImagesPullingTime="32.12563749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:44.247721869 +0000 UTC m=+220.408909439" watchObservedRunningTime="2026-10-29 23:17:44.248447931 +0000 UTC m=+220.409635500" Oct 29 23:17:44.299684 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.299304 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:44.343270 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.343248 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:44.354737 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.354710 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:44.422046 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.421969 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util\") pod \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " Oct 29 23:17:44.422046 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422028 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle\") pod \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " Oct 29 23:17:44.422297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422076 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm\" (UniqueName: \"kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm\") pod \"d0496135-ecec-42dc-9f44-9e57245ed57b\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " Oct 29 23:17:44.422297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422123 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z\" (UniqueName: \"kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z\") pod \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " Oct 29 23:17:44.422297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422156 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle\") pod \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\" (UID: \"10f6d66c-5c19-4138-9af9-e7ae1db97a0d\") " Oct 29 23:17:44.422297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422174 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util\") pod \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " Oct 29 23:17:44.422297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422203 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle\") pod \"d0496135-ecec-42dc-9f44-9e57245ed57b\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " Oct 29 23:17:44.422297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.422239 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util\") pod \"d0496135-ecec-42dc-9f44-9e57245ed57b\" (UID: \"d0496135-ecec-42dc-9f44-9e57245ed57b\") " Oct 29 23:17:44.423107 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.423059 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w\" (UniqueName: \"kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w\") pod \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\" (UID: \"d921d4ec-59bc-46ea-88c2-ab8f7738af12\") " Oct 29 23:17:44.423440 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.423412 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle" pod "10f6d66c-5c19-4138-9af9-e7ae1db97a0d" (UID: "10f6d66c-5c19-4138-9af9-e7ae1db97a0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:44.423836 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.423781 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle" pod "d0496135-ecec-42dc-9f44-9e57245ed57b" (UID: "d0496135-ecec-42dc-9f44-9e57245ed57b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:44.424106 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.424064 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle" pod "d921d4ec-59bc-46ea-88c2-ab8f7738af12" (UID: "d921d4ec-59bc-46ea-88c2-ab8f7738af12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:44.427594 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.427566 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z" pod "10f6d66c-5c19-4138-9af9-e7ae1db97a0d" (UID: "10f6d66c-5c19-4138-9af9-e7ae1db97a0d"). InnerVolumeSpecName "kube-api-access-7l89z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:44.428254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.428223 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm" pod "d0496135-ecec-42dc-9f44-9e57245ed57b" (UID: "d0496135-ecec-42dc-9f44-9e57245ed57b"). InnerVolumeSpecName "kube-api-access-j4gqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:44.428428 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.428404 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w" pod "d921d4ec-59bc-46ea-88c2-ab8f7738af12" (UID: "d921d4ec-59bc-46ea-88c2-ab8f7738af12"). InnerVolumeSpecName "kube-api-access-wsh8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:44.428548 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.428529 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util" pod "d921d4ec-59bc-46ea-88c2-ab8f7738af12" (UID: "d921d4ec-59bc-46ea-88c2-ab8f7738af12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:44.429478 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.429457 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util" pod "d0496135-ecec-42dc-9f44-9e57245ed57b" (UID: "d0496135-ecec-42dc-9f44-9e57245ed57b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:44.430681 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.430654 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util" pod "10f6d66c-5c19-4138-9af9-e7ae1db97a0d" (UID: "10f6d66c-5c19-4138-9af9-e7ae1db97a0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:44.524844 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524800 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.524844 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524843 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsh8w\" (UniqueName: \"kubernetes.io/projected/d921d4ec-59bc-46ea-88c2-ab8f7738af12-kube-api-access-wsh8w\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524859 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524873 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524887 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4gqm\" (UniqueName: \"kubernetes.io/projected/d0496135-ecec-42dc-9f44-9e57245ed57b-kube-api-access-j4gqm\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524900 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l89z\" (UniqueName: \"kubernetes.io/projected/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-kube-api-access-7l89z\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524914 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f6d66c-5c19-4138-9af9-e7ae1db97a0d-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524926 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d921d4ec-59bc-46ea-88c2-ab8f7738af12-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:44.525064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:44.524938 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0496135-ecec-42dc-9f44-9e57245ed57b-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.142963 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.142930 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" event={"ID":"d0496135-ecec-42dc-9f44-9e57245ed57b","Type":"ContainerDied","Data":"e980228fca0efc1202c8770133c3df80c6c53242ad394db367449ae7c1dc91c0"} Oct 29 23:17:45.143376 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.143003 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e980228fca0efc1202c8770133c3df80c6c53242ad394db367449ae7c1dc91c0" Oct 29 23:17:45.143376 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.142939 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cwdqvc" Oct 29 23:17:45.144670 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.144652 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" Oct 29 23:17:45.144670 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.144657 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c67klvr" event={"ID":"d921d4ec-59bc-46ea-88c2-ab8f7738af12","Type":"ContainerDied","Data":"8ffd8760835d24082de8006d1a997a3e32e02de4b1d063b16298c7d1b6ba7704"} Oct 29 23:17:45.144818 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.144694 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ffd8760835d24082de8006d1a997a3e32e02de4b1d063b16298c7d1b6ba7704" Oct 29 23:17:45.146721 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.146696 6133 generic.go:356] "Generic (PLEG): container finished" podID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerID="86c2d2bf20d1cc18ea3d0ebe570c9c6342e3c66c1e1b35f9b5c714cbf7867fc0" exitCode=0 Oct 29 23:17:45.146822 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.146782 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" event={"ID":"c5072e1f-295e-4af2-9fea-a47e1111ad45","Type":"ContainerDied","Data":"86c2d2bf20d1cc18ea3d0ebe570c9c6342e3c66c1e1b35f9b5c714cbf7867fc0"} Oct 29 23:17:45.148798 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.148781 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" event={"ID":"10f6d66c-5c19-4138-9af9-e7ae1db97a0d","Type":"ContainerDied","Data":"de84959faf7d9d12c32f03c6b9b89b8b4412ba9dc96b16913b8908c32d1a3d60"} Oct 29 23:17:45.148873 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.148800 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ctrh9d" Oct 29 23:17:45.148873 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.148808 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de84959faf7d9d12c32f03c6b9b89b8b4412ba9dc96b16913b8908c32d1a3d60" Oct 29 23:17:45.150909 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.150883 6133 generic.go:356] "Generic (PLEG): container finished" podID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerID="5d45e17447e6806b7b3d6e8d2f21ed02e0d8f6e00632b4383a9b44476b976445" exitCode=0 Oct 29 23:17:45.150998 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.150965 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" event={"ID":"98c6efb2-7d90-4e60-aa56-884cf7c638c1","Type":"ContainerDied","Data":"5d45e17447e6806b7b3d6e8d2f21ed02e0d8f6e00632b4383a9b44476b976445"} Oct 29 23:17:45.285965 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.285940 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:45.360112 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.360089 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:45.363247 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.363227 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:45.366469 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.366451 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:45.432124 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432067 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util\") pod \"e114436b-58b9-4801-a0c5-9056cd70f6fe\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " Oct 29 23:17:45.432124 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432103 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr\" (UniqueName: \"kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr\") pod \"1569848a-a4bc-4f95-a652-d6960d915116\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " Oct 29 23:17:45.432305 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432144 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle\") pod \"bbb75681-3acc-4389-84c6-d25ec8431285\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " Oct 29 23:17:45.432305 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432178 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util\") pod \"bbb75681-3acc-4389-84c6-d25ec8431285\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " Oct 29 23:17:45.432305 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432221 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle\") pod \"e114436b-58b9-4801-a0c5-9056cd70f6fe\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " Oct 29 23:17:45.432305 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432250 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f\" (UniqueName: \"kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f\") pod \"e114436b-58b9-4801-a0c5-9056cd70f6fe\" (UID: \"e114436b-58b9-4801-a0c5-9056cd70f6fe\") " Oct 29 23:17:45.432525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432305 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle\") pod \"1569848a-a4bc-4f95-a652-d6960d915116\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " Oct 29 23:17:45.432525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432360 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util\") pod \"e48337ed-9a9e-460c-b976-08570fa64e27\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " Oct 29 23:17:45.432525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432396 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq\" (UniqueName: \"kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq\") pod \"bbb75681-3acc-4389-84c6-d25ec8431285\" (UID: \"bbb75681-3acc-4389-84c6-d25ec8431285\") " Oct 29 23:17:45.432525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432423 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle\") pod \"e48337ed-9a9e-460c-b976-08570fa64e27\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " Oct 29 23:17:45.432525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432483 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk\" (UniqueName: \"kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk\") pod \"e48337ed-9a9e-460c-b976-08570fa64e27\" (UID: \"e48337ed-9a9e-460c-b976-08570fa64e27\") " Oct 29 23:17:45.432751 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432540 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util\") pod \"1569848a-a4bc-4f95-a652-d6960d915116\" (UID: \"1569848a-a4bc-4f95-a652-d6960d915116\") " Oct 29 23:17:45.432800 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432751 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle" pod "bbb75681-3acc-4389-84c6-d25ec8431285" (UID: "bbb75681-3acc-4389-84c6-d25ec8431285"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.432853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.432816 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.433527 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.433501 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle" pod "e114436b-58b9-4801-a0c5-9056cd70f6fe" (UID: "e114436b-58b9-4801-a0c5-9056cd70f6fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.433620 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.433520 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle" pod "e48337ed-9a9e-460c-b976-08570fa64e27" (UID: "e48337ed-9a9e-460c-b976-08570fa64e27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.433933 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.433912 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle" pod "1569848a-a4bc-4f95-a652-d6960d915116" (UID: "1569848a-a4bc-4f95-a652-d6960d915116"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.434714 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.434679 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr" pod "1569848a-a4bc-4f95-a652-d6960d915116" (UID: "1569848a-a4bc-4f95-a652-d6960d915116"). InnerVolumeSpecName "kube-api-access-phrkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:45.435037 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.434905 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f" pod "e114436b-58b9-4801-a0c5-9056cd70f6fe" (UID: "e114436b-58b9-4801-a0c5-9056cd70f6fe"). InnerVolumeSpecName "kube-api-access-qct2f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:45.435444 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.435366 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq" pod "bbb75681-3acc-4389-84c6-d25ec8431285" (UID: "bbb75681-3acc-4389-84c6-d25ec8431285"). InnerVolumeSpecName "kube-api-access-89lfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:45.437402 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.437362 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk" pod "e48337ed-9a9e-460c-b976-08570fa64e27" (UID: "e48337ed-9a9e-460c-b976-08570fa64e27"). InnerVolumeSpecName "kube-api-access-hnghk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:45.440457 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.440425 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util" pod "e114436b-58b9-4801-a0c5-9056cd70f6fe" (UID: "e114436b-58b9-4801-a0c5-9056cd70f6fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.440718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.440695 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util" pod "e48337ed-9a9e-460c-b976-08570fa64e27" (UID: "e48337ed-9a9e-460c-b976-08570fa64e27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.441048 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.441029 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util" pod "bbb75681-3acc-4389-84c6-d25ec8431285" (UID: "bbb75681-3acc-4389-84c6-d25ec8431285"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.442359 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.442336 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util" pod "1569848a-a4bc-4f95-a652-d6960d915116" (UID: "1569848a-a4bc-4f95-a652-d6960d915116"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:45.533986 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.533964 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.533986 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.533985 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qct2f\" (UniqueName: \"kubernetes.io/projected/e114436b-58b9-4801-a0c5-9056cd70f6fe-kube-api-access-qct2f\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.533996 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534004 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534013 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89lfq\" (UniqueName: \"kubernetes.io/projected/bbb75681-3acc-4389-84c6-d25ec8431285-kube-api-access-89lfq\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534021 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48337ed-9a9e-460c-b976-08570fa64e27-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534029 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnghk\" (UniqueName: \"kubernetes.io/projected/e48337ed-9a9e-460c-b976-08570fa64e27-kube-api-access-hnghk\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534038 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1569848a-a4bc-4f95-a652-d6960d915116-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534049 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e114436b-58b9-4801-a0c5-9056cd70f6fe-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534060 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phrkr\" (UniqueName: \"kubernetes.io/projected/1569848a-a4bc-4f95-a652-d6960d915116-kube-api-access-phrkr\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:45.534133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:45.534069 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb75681-3acc-4389-84c6-d25ec8431285-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:46.157765 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.157738 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" event={"ID":"e48337ed-9a9e-460c-b976-08570fa64e27","Type":"ContainerDied","Data":"4465601500c350c5c4b043f98b07bf2f9c24dcea43d0ca81ad82dbbe1f54330f"} Oct 29 23:17:46.158122 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.157780 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qcc6w" Oct 29 23:17:46.158122 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.157786 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4465601500c350c5c4b043f98b07bf2f9c24dcea43d0ca81ad82dbbe1f54330f" Oct 29 23:17:46.159932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.159909 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" Oct 29 23:17:46.160033 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.159904 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a45m9v" event={"ID":"e114436b-58b9-4801-a0c5-9056cd70f6fe","Type":"ContainerDied","Data":"9cfac13970b54cfffbb9df93d014efde6c5042886077b7767838320f54cf0220"} Oct 29 23:17:46.160107 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.160032 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cfac13970b54cfffbb9df93d014efde6c5042886077b7767838320f54cf0220" Oct 29 23:17:46.162257 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.162234 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" event={"ID":"bbb75681-3acc-4389-84c6-d25ec8431285","Type":"ContainerDied","Data":"c7ac9751dc40d96926074381d086f4c997678271f8013f1e85a02d907cb7f2cc"} Oct 29 23:17:46.162384 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.162273 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7ac9751dc40d96926074381d086f4c997678271f8013f1e85a02d907cb7f2cc" Oct 29 23:17:46.162384 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.162313 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d774fds" Oct 29 23:17:46.164605 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.164581 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" event={"ID":"1569848a-a4bc-4f95-a652-d6960d915116","Type":"ContainerDied","Data":"2ba05fa46759fe08c46343554d88ccfdbf3bb2c5a09d394d86cb34d3677b62e9"} Oct 29 23:17:46.164702 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.164619 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ba05fa46759fe08c46343554d88ccfdbf3bb2c5a09d394d86cb34d3677b62e9" Oct 29 23:17:46.164702 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.164680 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6kzlkt" Oct 29 23:17:46.284338 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.284317 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:46.308950 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.308929 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:46.441155 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441128 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s\" (UniqueName: \"kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s\") pod \"c5072e1f-295e-4af2-9fea-a47e1111ad45\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " Oct 29 23:17:46.441263 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441164 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle\") pod \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " Oct 29 23:17:46.441263 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441191 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz\" (UniqueName: \"kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz\") pod \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " Oct 29 23:17:46.441365 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441332 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util\") pod \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\" (UID: \"98c6efb2-7d90-4e60-aa56-884cf7c638c1\") " Oct 29 23:17:46.441405 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441376 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util\") pod \"c5072e1f-295e-4af2-9fea-a47e1111ad45\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " Oct 29 23:17:46.441441 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441423 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle\") pod \"c5072e1f-295e-4af2-9fea-a47e1111ad45\" (UID: \"c5072e1f-295e-4af2-9fea-a47e1111ad45\") " Oct 29 23:17:46.441871 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.441847 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle" pod "c5072e1f-295e-4af2-9fea-a47e1111ad45" (UID: "c5072e1f-295e-4af2-9fea-a47e1111ad45"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:46.442087 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.442064 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle" pod "98c6efb2-7d90-4e60-aa56-884cf7c638c1" (UID: "98c6efb2-7d90-4e60-aa56-884cf7c638c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:46.443342 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.443320 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz" pod "98c6efb2-7d90-4e60-aa56-884cf7c638c1" (UID: "98c6efb2-7d90-4e60-aa56-884cf7c638c1"). InnerVolumeSpecName "kube-api-access-v4cfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:46.443601 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.443584 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s" pod "c5072e1f-295e-4af2-9fea-a47e1111ad45" (UID: "c5072e1f-295e-4af2-9fea-a47e1111ad45"). InnerVolumeSpecName "kube-api-access-27b4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:17:46.446936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.446917 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util" pod "98c6efb2-7d90-4e60-aa56-884cf7c638c1" (UID: "98c6efb2-7d90-4e60-aa56-884cf7c638c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:46.447347 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.447328 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util" pod "c5072e1f-295e-4af2-9fea-a47e1111ad45" (UID: "c5072e1f-295e-4af2-9fea-a47e1111ad45"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:17:46.542808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.542750 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27b4s\" (UniqueName: \"kubernetes.io/projected/c5072e1f-295e-4af2-9fea-a47e1111ad45-kube-api-access-27b4s\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:46.542808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.542772 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:46.542808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.542782 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4cfz\" (UniqueName: \"kubernetes.io/projected/98c6efb2-7d90-4e60-aa56-884cf7c638c1-kube-api-access-v4cfz\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:46.542808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.542791 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98c6efb2-7d90-4e60-aa56-884cf7c638c1-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:46.542808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.542799 6133 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-util\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:46.542808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:46.542807 6133 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5072e1f-295e-4af2-9fea-a47e1111ad45-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:17:47.170819 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:47.170784 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" Oct 29 23:17:47.171251 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:47.170785 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644mcqbj" event={"ID":"c5072e1f-295e-4af2-9fea-a47e1111ad45","Type":"ContainerDied","Data":"eff8d30a1cc27e4f12529c48873f8383c05732318694727a6d3e12c513cdbdf9"} Oct 29 23:17:47.171251 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:47.170913 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eff8d30a1cc27e4f12529c48873f8383c05732318694727a6d3e12c513cdbdf9" Oct 29 23:17:47.172776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:47.172748 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" event={"ID":"98c6efb2-7d90-4e60-aa56-884cf7c638c1","Type":"ContainerDied","Data":"4e6904e48935d5b102e83f6634864894fbbfb8569b8e6f3b2a2f15a2aa25aa55"} Oct 29 23:17:47.172776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:47.172776 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c8lpjw" Oct 29 23:17:47.172932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:47.172794 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e6904e48935d5b102e83f6634864894fbbfb8569b8e6f3b2a2f15a2aa25aa55" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.177817 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb"] Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178213 6133 cpu_manager.go:414] "containerMap: removing container" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178230 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178246 6133 cpu_manager.go:414] "containerMap: removing container" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178253 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178324 6133 cpu_manager.go:414] "containerMap: removing container" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178333 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178343 6133 cpu_manager.go:414] "containerMap: removing container" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178351 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178366 6133 cpu_manager.go:414] "containerMap: removing container" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178383 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178397 6133 cpu_manager.go:414] "containerMap: removing container" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178404 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178413 6133 cpu_manager.go:414] "containerMap: removing container" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178420 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178435 6133 cpu_manager.go:414] "containerMap: removing container" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178443 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178452 6133 cpu_manager.go:414] "containerMap: removing container" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178460 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178471 6133 cpu_manager.go:414] "containerMap: removing container" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178478 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178490 6133 cpu_manager.go:414] "containerMap: removing container" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178497 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178509 6133 cpu_manager.go:414] "containerMap: removing container" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178516 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178527 6133 cpu_manager.go:414] "containerMap: removing container" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178534 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178548 6133 cpu_manager.go:414] "containerMap: removing container" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178555 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178570 6133 cpu_manager.go:414] "containerMap: removing container" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178576 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178615 6133 cpu_manager.go:414] "containerMap: removing container" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178623 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178633 6133 cpu_manager.go:414] "containerMap: removing container" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178640 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178649 6133 cpu_manager.go:414] "containerMap: removing container" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178657 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178670 6133 cpu_manager.go:414] "containerMap: removing container" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178676 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178686 6133 cpu_manager.go:414] "containerMap: removing container" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178693 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178706 6133 cpu_manager.go:414] "containerMap: removing container" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178713 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178723 6133 cpu_manager.go:414] "containerMap: removing container" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178730 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178741 6133 cpu_manager.go:414] "containerMap: removing container" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178748 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178764 6133 cpu_manager.go:414] "containerMap: removing container" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178771 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178780 6133 cpu_manager.go:414] "containerMap: removing container" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178786 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178795 6133 cpu_manager.go:414] "containerMap: removing container" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178801 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="util" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178811 6133 cpu_manager.go:414] "containerMap: removing container" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178817 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="pull" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178901 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="1569848a-a4bc-4f95-a652-d6960d915116" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178912 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5072e1f-295e-4af2-9fea-a47e1111ad45" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178921 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbb75681-3acc-4389-84c6-d25ec8431285" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178929 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="98c6efb2-7d90-4e60-aa56-884cf7c638c1" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178939 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="d921d4ec-59bc-46ea-88c2-ab8f7738af12" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178948 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="e48337ed-9a9e-460c-b976-08570fa64e27" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178956 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="10f6d66c-5c19-4138-9af9-e7ae1db97a0d" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178964 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0496135-ecec-42dc-9f44-9e57245ed57b" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.178973 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="e114436b-58b9-4801-a0c5-9056cd70f6fe" containerName="extract" Oct 29 23:17:50.183398 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.182053 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.202330 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.202308 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-5l76q\"" Oct 29 23:17:50.202444 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.202393 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Oct 29 23:17:50.208558 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.208544 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 29 23:17:50.213725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.213705 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Oct 29 23:17:50.213866 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.213732 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Oct 29 23:17:50.222816 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.222791 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb"] Oct 29 23:17:50.280905 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.280883 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.280989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.280912 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.280989 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.280929 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgcws\" (UniqueName: \"kubernetes.io/projected/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-kube-api-access-rgcws\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.281077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.281035 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.281116 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.281078 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.281116 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.281097 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.315611 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.315591 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 29 23:17:50.382146 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382124 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.382261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382159 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.382261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382190 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.382261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382207 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.382261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382222 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgcws\" (UniqueName: \"kubernetes.io/projected/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-kube-api-access-rgcws\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.382261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382256 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.382648 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.382626 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.384299 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.384263 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.384429 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.384413 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.384675 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.384654 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.384716 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.384661 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.401691 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.401669 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgcws\" (UniqueName: \"kubernetes.io/projected/a18c741f-f01f-41d5-8ec5-e941b91dc3f1-kube-api-access-rgcws\") pod \"opendatahub-operator-controller-manager-5588597fcf-rwgwb\" (UID: \"a18c741f-f01f-41d5-8ec5-e941b91dc3f1\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.497802 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.497749 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:50.851877 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:50.851801 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb"] Oct 29 23:17:50.868898 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:17:50.868873 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda18c741f_f01f_41d5_8ec5_e941b91dc3f1.slice/crio-df5bc1f4ebab1eaa053a17a9ff766e1b05344097605f5763f27f63a8ee713b6a WatchSource:0}: Error finding container df5bc1f4ebab1eaa053a17a9ff766e1b05344097605f5763f27f63a8ee713b6a: Status 404 returned error can't find the container with id df5bc1f4ebab1eaa053a17a9ff766e1b05344097605f5763f27f63a8ee713b6a Oct 29 23:17:51.194650 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:51.194619 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" event={"ID":"a18c741f-f01f-41d5-8ec5-e941b91dc3f1","Type":"ContainerStarted","Data":"df5bc1f4ebab1eaa053a17a9ff766e1b05344097605f5763f27f63a8ee713b6a"} Oct 29 23:17:54.211332 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:54.211300 6133 generic.go:356] "Generic (PLEG): container finished" podID="a18c741f-f01f-41d5-8ec5-e941b91dc3f1" containerID="f300794fe789c5b436e081090bf6ec0f7f241a8582decdb39941c83ac5726015" exitCode=0 Oct 29 23:17:54.211687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:54.211354 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" event={"ID":"a18c741f-f01f-41d5-8ec5-e941b91dc3f1","Type":"ContainerDied","Data":"f300794fe789c5b436e081090bf6ec0f7f241a8582decdb39941c83ac5726015"} Oct 29 23:17:55.217455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:55.217424 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" event={"ID":"a18c741f-f01f-41d5-8ec5-e941b91dc3f1","Type":"ContainerStarted","Data":"1a4777cbeeb42251d3b32656e38194986d15e8499f957a08d67c029c30d13e33"} Oct 29 23:17:55.217835 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:55.217538 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:17:55.300323 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:17:55.300258 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" podStartSLOduration=1.9305968180000002 podStartE2EDuration="5.300244245s" totalImagesPullingTime="2.954673582s" totalInitContainerRuntime="414.973845ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:55.287855881 +0000 UTC m=+231.449043476" watchObservedRunningTime="2026-10-29 23:17:55.300244245 +0000 UTC m=+231.461431815" Oct 29 23:18:01.933467 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.933432 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb"] Oct 29 23:18:01.937934 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.937914 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:01.956664 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.956636 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb"] Oct 29 23:18:01.966560 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.966538 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7pzfp\"" Oct 29 23:18:01.966678 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.966540 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Oct 29 23:18:01.966678 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.966573 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:18:01.990738 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.990709 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcx8n\" (UniqueName: \"kubernetes.io/projected/796e7c43-16ce-4f0e-ac22-b25679d6cc39-kube-api-access-lcx8n\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb\" (UID: \"796e7c43-16ce-4f0e-ac22-b25679d6cc39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:01.990848 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:01.990758 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/796e7c43-16ce-4f0e-ac22-b25679d6cc39-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb\" (UID: \"796e7c43-16ce-4f0e-ac22-b25679d6cc39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:02.091921 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.091888 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/796e7c43-16ce-4f0e-ac22-b25679d6cc39-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb\" (UID: \"796e7c43-16ce-4f0e-ac22-b25679d6cc39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:02.092109 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.091957 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcx8n\" (UniqueName: \"kubernetes.io/projected/796e7c43-16ce-4f0e-ac22-b25679d6cc39-kube-api-access-lcx8n\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb\" (UID: \"796e7c43-16ce-4f0e-ac22-b25679d6cc39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:02.092358 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.092337 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/796e7c43-16ce-4f0e-ac22-b25679d6cc39-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb\" (UID: \"796e7c43-16ce-4f0e-ac22-b25679d6cc39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:02.113888 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.113855 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcx8n\" (UniqueName: \"kubernetes.io/projected/796e7c43-16ce-4f0e-ac22-b25679d6cc39-kube-api-access-lcx8n\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb\" (UID: \"796e7c43-16ce-4f0e-ac22-b25679d6cc39\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:02.231324 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.231263 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2"] Oct 29 23:18:02.233858 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.233839 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.247709 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.247686 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" Oct 29 23:18:02.247818 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.247779 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zr9k2\"" Oct 29 23:18:02.248238 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.248222 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 29 23:18:02.248362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.248270 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 29 23:18:02.263018 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.262994 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2"] Oct 29 23:18:02.293301 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.293263 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-ml8l2\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.293495 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.293317 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkvp7\" (UniqueName: \"kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7\") pod \"kuadrant-operator-controller-manager-cf8469d7b-ml8l2\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.393943 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.393915 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-ml8l2\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.393943 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.393948 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkvp7\" (UniqueName: \"kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7\") pod \"kuadrant-operator-controller-manager-cf8469d7b-ml8l2\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.394345 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.394324 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-ml8l2\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.415196 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.415168 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkvp7\" (UniqueName: \"kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7\") pod \"kuadrant-operator-controller-manager-cf8469d7b-ml8l2\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.547433 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.547372 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:02.573300 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.573264 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb"] Oct 29 23:18:02.590483 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:02.590459 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796e7c43_16ce_4f0e_ac22_b25679d6cc39.slice/crio-fd08cfd14ff7ae6368214f887b101e78d5e74c1df068bde3fa4d1211f19bf11e WatchSource:0}: Error finding container fd08cfd14ff7ae6368214f887b101e78d5e74c1df068bde3fa4d1211f19bf11e: Status 404 returned error can't find the container with id fd08cfd14ff7ae6368214f887b101e78d5e74c1df068bde3fa4d1211f19bf11e Oct 29 23:18:02.855139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:02.855057 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2"] Oct 29 23:18:02.858662 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:02.858640 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd433e47_f072_44ef_aae8_ce01e70a8c2f.slice/crio-35c1f39d0187816d1f74f06b2e1ad77bb3fcbfd56b48736c63e02b73a60f2de5 WatchSource:0}: Error finding container 35c1f39d0187816d1f74f06b2e1ad77bb3fcbfd56b48736c63e02b73a60f2de5: Status 404 returned error can't find the container with id 35c1f39d0187816d1f74f06b2e1ad77bb3fcbfd56b48736c63e02b73a60f2de5 Oct 29 23:18:03.250128 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:03.250098 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" event={"ID":"cd433e47-f072-44ef-aae8-ce01e70a8c2f","Type":"ContainerStarted","Data":"35c1f39d0187816d1f74f06b2e1ad77bb3fcbfd56b48736c63e02b73a60f2de5"} Oct 29 23:18:03.251362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:03.251339 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" event={"ID":"796e7c43-16ce-4f0e-ac22-b25679d6cc39","Type":"ContainerStarted","Data":"fd08cfd14ff7ae6368214f887b101e78d5e74c1df068bde3fa4d1211f19bf11e"} Oct 29 23:18:05.273247 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:05.272613 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" event={"ID":"796e7c43-16ce-4f0e-ac22-b25679d6cc39","Type":"ContainerStarted","Data":"2554b0e5815fb8883bd9b3ee469174a6913d7c0d912aa83ecd910aa78a4a65ae"} Oct 29 23:18:05.339753 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:05.338092 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-4dkcb" podStartSLOduration=1.749591906 podStartE2EDuration="4.338074714s" totalImagesPullingTime="2.588482808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:05.337568067 +0000 UTC m=+241.498755637" watchObservedRunningTime="2026-10-29 23:18:05.338074714 +0000 UTC m=+241.499262285" Oct 29 23:18:06.224880 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.224845 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-rwgwb" Oct 29 23:18:06.567138 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.567060 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b"] Oct 29 23:18:06.569759 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.569731 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:06.583883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.583858 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Oct 29 23:18:06.583990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.583974 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hbnh4\"" Oct 29 23:18:06.594231 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.594210 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b"] Oct 29 23:18:06.628932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.628910 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv9mz\" (UniqueName: \"kubernetes.io/projected/0471e557-49fa-40fc-9266-f985ac58d510-kube-api-access-fv9mz\") pod \"dns-operator-controller-manager-8557cbdb84-j2b9b\" (UID: \"0471e557-49fa-40fc-9266-f985ac58d510\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:06.680805 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.680777 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9"] Oct 29 23:18:06.683092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.683066 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.696931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.696906 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Oct 29 23:18:06.697024 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.696927 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Oct 29 23:18:06.697146 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.697130 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-nfppd\"" Oct 29 23:18:06.705256 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.705234 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9"] Oct 29 23:18:06.730347 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.730325 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cfxk\" (UniqueName: \"kubernetes.io/projected/f0b2945f-0bfb-4daa-bbb1-9b5ec8960517-kube-api-access-6cfxk\") pod \"jobset-operator-674cd59dc5-m65v9\" (UID: \"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.730437 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.730391 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv9mz\" (UniqueName: \"kubernetes.io/projected/0471e557-49fa-40fc-9266-f985ac58d510-kube-api-access-fv9mz\") pod \"dns-operator-controller-manager-8557cbdb84-j2b9b\" (UID: \"0471e557-49fa-40fc-9266-f985ac58d510\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:06.730502 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.730483 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b2945f-0bfb-4daa-bbb1-9b5ec8960517-tmp\") pod \"jobset-operator-674cd59dc5-m65v9\" (UID: \"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.749733 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.749709 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv9mz\" (UniqueName: \"kubernetes.io/projected/0471e557-49fa-40fc-9266-f985ac58d510-kube-api-access-fv9mz\") pod \"dns-operator-controller-manager-8557cbdb84-j2b9b\" (UID: \"0471e557-49fa-40fc-9266-f985ac58d510\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:06.831358 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.831270 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b2945f-0bfb-4daa-bbb1-9b5ec8960517-tmp\") pod \"jobset-operator-674cd59dc5-m65v9\" (UID: \"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.831514 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.831372 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cfxk\" (UniqueName: \"kubernetes.io/projected/f0b2945f-0bfb-4daa-bbb1-9b5ec8960517-kube-api-access-6cfxk\") pod \"jobset-operator-674cd59dc5-m65v9\" (UID: \"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.831685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.831662 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0b2945f-0bfb-4daa-bbb1-9b5ec8960517-tmp\") pod \"jobset-operator-674cd59dc5-m65v9\" (UID: \"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.853672 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.853641 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cfxk\" (UniqueName: \"kubernetes.io/projected/f0b2945f-0bfb-4daa-bbb1-9b5ec8960517-kube-api-access-6cfxk\") pod \"jobset-operator-674cd59dc5-m65v9\" (UID: \"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:06.883377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:06.883351 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:07.001812 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:07.001781 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" Oct 29 23:18:07.196160 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:07.196122 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b"] Oct 29 23:18:07.201392 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:07.201360 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0471e557_49fa_40fc_9266_f985ac58d510.slice/crio-00f5629b77a81d6496a3287ec11c657e078a5e4c543c8ac0baf3ecd6c3d880e9 WatchSource:0}: Error finding container 00f5629b77a81d6496a3287ec11c657e078a5e4c543c8ac0baf3ecd6c3d880e9: Status 404 returned error can't find the container with id 00f5629b77a81d6496a3287ec11c657e078a5e4c543c8ac0baf3ecd6c3d880e9 Oct 29 23:18:07.283723 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:07.283697 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" event={"ID":"0471e557-49fa-40fc-9266-f985ac58d510","Type":"ContainerStarted","Data":"00f5629b77a81d6496a3287ec11c657e078a5e4c543c8ac0baf3ecd6c3d880e9"} Oct 29 23:18:07.300059 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:07.300007 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9"] Oct 29 23:18:07.304107 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:07.304086 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0b2945f_0bfb_4daa_bbb1_9b5ec8960517.slice/crio-f0344e8bae918c91b11cc5dd3471530b01855f040045108369d48275dbe0ef05 WatchSource:0}: Error finding container f0344e8bae918c91b11cc5dd3471530b01855f040045108369d48275dbe0ef05: Status 404 returned error can't find the container with id f0344e8bae918c91b11cc5dd3471530b01855f040045108369d48275dbe0ef05 Oct 29 23:18:08.291095 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:08.291055 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" event={"ID":"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517","Type":"ContainerStarted","Data":"f0344e8bae918c91b11cc5dd3471530b01855f040045108369d48275dbe0ef05"} Oct 29 23:18:08.293316 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:08.293264 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" event={"ID":"cd433e47-f072-44ef-aae8-ce01e70a8c2f","Type":"ContainerStarted","Data":"ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0"} Oct 29 23:18:08.294169 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:08.294104 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:08.360535 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:08.360472 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" podStartSLOduration=1.95788892 podStartE2EDuration="6.36043681s" totalImagesPullingTime="4.40254789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:08.34785842 +0000 UTC m=+244.509045985" watchObservedRunningTime="2026-10-29 23:18:08.36043681 +0000 UTC m=+244.521624382" Oct 29 23:18:09.299888 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:09.299857 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" event={"ID":"0471e557-49fa-40fc-9266-f985ac58d510","Type":"ContainerStarted","Data":"6519c78541f934335a76f6da4d65e4a40c7963f77bbeeed825d54b0885950b50"} Oct 29 23:18:09.300400 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:09.299973 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:09.301731 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:09.301712 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" event={"ID":"f0b2945f-0bfb-4daa-bbb1-9b5ec8960517","Type":"ContainerStarted","Data":"0e03bf3fc38d74c514ac49bf6d6ce7155f1e9db6f0f4fd04676b78fa5a3912b9"} Oct 29 23:18:09.347294 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:09.347236 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" podStartSLOduration=1.762660396 podStartE2EDuration="3.347219515s" totalImagesPullingTime="1.584559119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:09.34547287 +0000 UTC m=+245.506660439" watchObservedRunningTime="2026-10-29 23:18:09.347219515 +0000 UTC m=+245.508407087" Oct 29 23:18:09.397688 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:09.397649 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-m65v9" podStartSLOduration=1.597517139 podStartE2EDuration="3.397636957s" totalImagesPullingTime="1.800119818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:09.396388498 +0000 UTC m=+245.557576067" watchObservedRunningTime="2026-10-29 23:18:09.397636957 +0000 UTC m=+245.558824528" Oct 29 23:18:13.447383 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:18:13.447351 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:18:14.578586 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.578549 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c"] Oct 29 23:18:14.581639 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.581622 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.606580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.606552 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Oct 29 23:18:14.606818 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.606803 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7q442\"" Oct 29 23:18:14.606912 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.606827 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Oct 29 23:18:14.608470 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.608439 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c"] Oct 29 23:18:14.698523 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.698499 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bmzw\" (UniqueName: \"kubernetes.io/projected/f0819649-64ee-45a9-bf40-162fae2a640e-kube-api-access-7bmzw\") pod \"cert-manager-cainjector-5c57bbd4fc-xnz4c\" (UID: \"f0819649-64ee-45a9-bf40-162fae2a640e\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.698623 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.698534 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0819649-64ee-45a9-bf40-162fae2a640e-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-xnz4c\" (UID: \"f0819649-64ee-45a9-bf40-162fae2a640e\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.799430 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.799393 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bmzw\" (UniqueName: \"kubernetes.io/projected/f0819649-64ee-45a9-bf40-162fae2a640e-kube-api-access-7bmzw\") pod \"cert-manager-cainjector-5c57bbd4fc-xnz4c\" (UID: \"f0819649-64ee-45a9-bf40-162fae2a640e\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.799430 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.799440 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0819649-64ee-45a9-bf40-162fae2a640e-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-xnz4c\" (UID: \"f0819649-64ee-45a9-bf40-162fae2a640e\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.817812 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.817780 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f0819649-64ee-45a9-bf40-162fae2a640e-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-xnz4c\" (UID: \"f0819649-64ee-45a9-bf40-162fae2a640e\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.818002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.817982 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bmzw\" (UniqueName: \"kubernetes.io/projected/f0819649-64ee-45a9-bf40-162fae2a640e-kube-api-access-7bmzw\") pod \"cert-manager-cainjector-5c57bbd4fc-xnz4c\" (UID: \"f0819649-64ee-45a9-bf40-162fae2a640e\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:14.891409 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:14.891384 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" Oct 29 23:18:15.192153 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:15.192082 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c"] Oct 29 23:18:15.196084 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:15.196054 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0819649_64ee_45a9_bf40_162fae2a640e.slice/crio-c11562ea8e09c58cfa7edb4c790623f6b073b62c0c50c75b01959cbcee108ed4 WatchSource:0}: Error finding container c11562ea8e09c58cfa7edb4c790623f6b073b62c0c50c75b01959cbcee108ed4: Status 404 returned error can't find the container with id c11562ea8e09c58cfa7edb4c790623f6b073b62c0c50c75b01959cbcee108ed4 Oct 29 23:18:15.329914 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:15.329885 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" event={"ID":"f0819649-64ee-45a9-bf40-162fae2a640e","Type":"ContainerStarted","Data":"c11562ea8e09c58cfa7edb4c790623f6b073b62c0c50c75b01959cbcee108ed4"} Oct 29 23:18:18.115369 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.115341 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-dbngb"] Oct 29 23:18:18.118064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.118045 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.138356 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.138336 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xc57f\"" Oct 29 23:18:18.144332 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.144311 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-dbngb"] Oct 29 23:18:18.228210 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.228188 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21a75c65-a57a-480a-8f81-c9afebaa8753-bound-sa-token\") pod \"cert-manager-597b95cb84-dbngb\" (UID: \"21a75c65-a57a-480a-8f81-c9afebaa8753\") " pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.228353 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.228267 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqxw\" (UniqueName: \"kubernetes.io/projected/21a75c65-a57a-480a-8f81-c9afebaa8753-kube-api-access-gpqxw\") pod \"cert-manager-597b95cb84-dbngb\" (UID: \"21a75c65-a57a-480a-8f81-c9afebaa8753\") " pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.329623 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.329560 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21a75c65-a57a-480a-8f81-c9afebaa8753-bound-sa-token\") pod \"cert-manager-597b95cb84-dbngb\" (UID: \"21a75c65-a57a-480a-8f81-c9afebaa8753\") " pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.329623 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.329619 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqxw\" (UniqueName: \"kubernetes.io/projected/21a75c65-a57a-480a-8f81-c9afebaa8753-kube-api-access-gpqxw\") pod \"cert-manager-597b95cb84-dbngb\" (UID: \"21a75c65-a57a-480a-8f81-c9afebaa8753\") " pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.348259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.348231 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqxw\" (UniqueName: \"kubernetes.io/projected/21a75c65-a57a-480a-8f81-c9afebaa8753-kube-api-access-gpqxw\") pod \"cert-manager-597b95cb84-dbngb\" (UID: \"21a75c65-a57a-480a-8f81-c9afebaa8753\") " pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.348259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.348254 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21a75c65-a57a-480a-8f81-c9afebaa8753-bound-sa-token\") pod \"cert-manager-597b95cb84-dbngb\" (UID: \"21a75c65-a57a-480a-8f81-c9afebaa8753\") " pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.348975 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.348951 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" event={"ID":"f0819649-64ee-45a9-bf40-162fae2a640e","Type":"ContainerStarted","Data":"fd092b69042494a87095263ab70faf9fb79acf292a36a15a7e9bcdb7fed3b98f"} Oct 29 23:18:18.385577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.385540 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-xnz4c" podStartSLOduration=1.538307477 podStartE2EDuration="4.385527955s" totalImagesPullingTime="2.847220478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:18.385110542 +0000 UTC m=+254.546298111" watchObservedRunningTime="2026-10-29 23:18:18.385527955 +0000 UTC m=+254.546715524" Oct 29 23:18:18.428715 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.428688 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-dbngb" Oct 29 23:18:18.723278 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:18.723088 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-dbngb"] Oct 29 23:18:18.727786 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:18.727757 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21a75c65_a57a_480a_8f81_c9afebaa8753.slice/crio-22373fdbb760e61eb08e75f7c279e98f0163be6b927a7197f136e9cb486266f8 WatchSource:0}: Error finding container 22373fdbb760e61eb08e75f7c279e98f0163be6b927a7197f136e9cb486266f8: Status 404 returned error can't find the container with id 22373fdbb760e61eb08e75f7c279e98f0163be6b927a7197f136e9cb486266f8 Oct 29 23:18:19.355531 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:19.355502 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-dbngb" event={"ID":"21a75c65-a57a-480a-8f81-c9afebaa8753","Type":"ContainerStarted","Data":"9a995fd71bc16ebf8b5dc2a23fc5c889391a4bb56fae489fc7ba607ebad0f987"} Oct 29 23:18:19.355994 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:19.355545 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-dbngb" event={"ID":"21a75c65-a57a-480a-8f81-c9afebaa8753","Type":"ContainerStarted","Data":"22373fdbb760e61eb08e75f7c279e98f0163be6b927a7197f136e9cb486266f8"} Oct 29 23:18:19.393190 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:19.393145 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-dbngb" podStartSLOduration=1.393133302 podStartE2EDuration="1.393133302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:19.391830712 +0000 UTC m=+255.553018281" watchObservedRunningTime="2026-10-29 23:18:19.393133302 +0000 UTC m=+255.554320872" Oct 29 23:18:20.308625 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.308597 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-j2b9b" Oct 29 23:18:20.308775 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.308662 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:20.747690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.747659 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z"] Oct 29 23:18:20.750352 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.750331 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:20.788368 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.788345 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z"] Oct 29 23:18:20.851370 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.851346 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d62f7a32-a650-47f1-a8fc-ad343fe9bce8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-xsd7z\" (UID: \"d62f7a32-a650-47f1-a8fc-ad343fe9bce8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:20.851484 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.851384 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c44gq\" (UniqueName: \"kubernetes.io/projected/d62f7a32-a650-47f1-a8fc-ad343fe9bce8-kube-api-access-c44gq\") pod \"kuadrant-operator-controller-manager-678d87766f-xsd7z\" (UID: \"d62f7a32-a650-47f1-a8fc-ad343fe9bce8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:20.952404 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.952374 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d62f7a32-a650-47f1-a8fc-ad343fe9bce8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-xsd7z\" (UID: \"d62f7a32-a650-47f1-a8fc-ad343fe9bce8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:20.952525 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.952414 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c44gq\" (UniqueName: \"kubernetes.io/projected/d62f7a32-a650-47f1-a8fc-ad343fe9bce8-kube-api-access-c44gq\") pod \"kuadrant-operator-controller-manager-678d87766f-xsd7z\" (UID: \"d62f7a32-a650-47f1-a8fc-ad343fe9bce8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:20.952773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.952751 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d62f7a32-a650-47f1-a8fc-ad343fe9bce8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-xsd7z\" (UID: \"d62f7a32-a650-47f1-a8fc-ad343fe9bce8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:20.973924 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:20.973903 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c44gq\" (UniqueName: \"kubernetes.io/projected/d62f7a32-a650-47f1-a8fc-ad343fe9bce8-kube-api-access-c44gq\") pod \"kuadrant-operator-controller-manager-678d87766f-xsd7z\" (UID: \"d62f7a32-a650-47f1-a8fc-ad343fe9bce8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:21.061978 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:21.061926 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:21.386662 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:21.386576 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z"] Oct 29 23:18:21.390857 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:21.390831 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62f7a32_a650_47f1_a8fc_ad343fe9bce8.slice/crio-0480b6da0f1a4609a0c2ed340bd7104c09d61c0187f7d0557d97168f79b5070b WatchSource:0}: Error finding container 0480b6da0f1a4609a0c2ed340bd7104c09d61c0187f7d0557d97168f79b5070b: Status 404 returned error can't find the container with id 0480b6da0f1a4609a0c2ed340bd7104c09d61c0187f7d0557d97168f79b5070b Oct 29 23:18:22.372299 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:22.372245 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" event={"ID":"d62f7a32-a650-47f1-a8fc-ad343fe9bce8","Type":"ContainerStarted","Data":"799e08c6a7e11110de73b3a589d0346991e5b92d9d68e25b8fdd3c66bff2c986"} Oct 29 23:18:22.372707 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:22.372325 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" event={"ID":"d62f7a32-a650-47f1-a8fc-ad343fe9bce8","Type":"ContainerStarted","Data":"0480b6da0f1a4609a0c2ed340bd7104c09d61c0187f7d0557d97168f79b5070b"} Oct 29 23:18:22.372707 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:22.372416 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:22.438501 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:22.438459 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" podStartSLOduration=2.438444992 podStartE2EDuration="2.438444992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:22.426327844 +0000 UTC m=+258.587515411" watchObservedRunningTime="2026-10-29 23:18:22.438444992 +0000 UTC m=+258.599632562" Oct 29 23:18:24.938929 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.938892 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z"] Oct 29 23:18:24.944961 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.944937 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:24.974070 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.974043 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z"] Oct 29 23:18:24.988615 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.988587 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e63d4283-4f65-4b45-9130-187cc190f8e0-tmp\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:24.988740 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.988620 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jbwq\" (UniqueName: \"kubernetes.io/projected/e63d4283-4f65-4b45-9130-187cc190f8e0-kube-api-access-4jbwq\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:24.988782 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.988761 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e63d4283-4f65-4b45-9130-187cc190f8e0-tls-certs\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:24.999728 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:24.999705 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Oct 29 23:18:25.004784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.004765 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r9wbl\"" Oct 29 23:18:25.004784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.004777 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Oct 29 23:18:25.089818 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.089795 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e63d4283-4f65-4b45-9130-187cc190f8e0-tls-certs\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.089941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.089839 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e63d4283-4f65-4b45-9130-187cc190f8e0-tmp\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.089941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.089858 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jbwq\" (UniqueName: \"kubernetes.io/projected/e63d4283-4f65-4b45-9130-187cc190f8e0-kube-api-access-4jbwq\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.092068 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.092039 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e63d4283-4f65-4b45-9130-187cc190f8e0-tmp\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.092211 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.092193 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e63d4283-4f65-4b45-9130-187cc190f8e0-tls-certs\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.111589 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.111564 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jbwq\" (UniqueName: \"kubernetes.io/projected/e63d4283-4f65-4b45-9130-187cc190f8e0-kube-api-access-4jbwq\") pod \"kube-auth-proxy-57dbfbcbdf-vwl7z\" (UID: \"e63d4283-4f65-4b45-9130-187cc190f8e0\") " pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.255706 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.255637 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" Oct 29 23:18:25.559995 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:25.559906 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z"] Oct 29 23:18:25.564292 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:25.564247 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63d4283_4f65_4b45_9130_187cc190f8e0.slice/crio-b6b8a69a7204720862c9a27a09635c7a60f95824737544fdbdb78033bacbb876 WatchSource:0}: Error finding container b6b8a69a7204720862c9a27a09635c7a60f95824737544fdbdb78033bacbb876: Status 404 returned error can't find the container with id b6b8a69a7204720862c9a27a09635c7a60f95824737544fdbdb78033bacbb876 Oct 29 23:18:26.399148 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:26.399107 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" event={"ID":"e63d4283-4f65-4b45-9130-187cc190f8e0","Type":"ContainerStarted","Data":"b6b8a69a7204720862c9a27a09635c7a60f95824737544fdbdb78033bacbb876"} Oct 29 23:18:28.411831 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:28.411795 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" event={"ID":"e63d4283-4f65-4b45-9130-187cc190f8e0","Type":"ContainerStarted","Data":"fab59efe93e4edd979653584ad85687f5bc1b26982be9245b0fe8044d532c1e5"} Oct 29 23:18:28.453178 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:28.453128 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57dbfbcbdf-vwl7z" podStartSLOduration=1.973579681 podStartE2EDuration="4.453114173s" totalImagesPullingTime="2.479534492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:28.45215886 +0000 UTC m=+264.613346430" watchObservedRunningTime="2026-10-29 23:18:28.453114173 +0000 UTC m=+264.614301742" Oct 29 23:18:33.378727 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.378696 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-xsd7z" Oct 29 23:18:33.463636 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.463607 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2"] Oct 29 23:18:33.463881 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.463839 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" podUID="cd433e47-f072-44ef-aae8-ce01e70a8c2f" containerName="manager" containerID="cri-o://ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0" gracePeriod=10 Oct 29 23:18:33.700968 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.700943 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:33.763129 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.763103 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7\" (UniqueName: \"kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7\") pod \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " Oct 29 23:18:33.763254 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.763220 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume\") pod \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\" (UID: \"cd433e47-f072-44ef-aae8-ce01e70a8c2f\") " Oct 29 23:18:33.763700 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.763673 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume" pod "cd433e47-f072-44ef-aae8-ce01e70a8c2f" (UID: "cd433e47-f072-44ef-aae8-ce01e70a8c2f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:18:33.765372 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.765346 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7" pod "cd433e47-f072-44ef-aae8-ce01e70a8c2f" (UID: "cd433e47-f072-44ef-aae8-ce01e70a8c2f"). InnerVolumeSpecName "kube-api-access-mkvp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:18:33.863988 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.863962 6133 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd433e47-f072-44ef-aae8-ce01e70a8c2f-extensions-socket-volume\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:18:33.864079 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:33.863992 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkvp7\" (UniqueName: \"kubernetes.io/projected/cd433e47-f072-44ef-aae8-ce01e70a8c2f-kube-api-access-mkvp7\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:18:34.441793 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.441756 6133 generic.go:356] "Generic (PLEG): container finished" podID="cd433e47-f072-44ef-aae8-ce01e70a8c2f" containerID="ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0" exitCode=0 Oct 29 23:18:34.442242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.441803 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" Oct 29 23:18:34.442242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.441827 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" event={"ID":"cd433e47-f072-44ef-aae8-ce01e70a8c2f","Type":"ContainerDied","Data":"ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0"} Oct 29 23:18:34.442242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.441875 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2" event={"ID":"cd433e47-f072-44ef-aae8-ce01e70a8c2f","Type":"ContainerDied","Data":"35c1f39d0187816d1f74f06b2e1ad77bb3fcbfd56b48736c63e02b73a60f2de5"} Oct 29 23:18:34.442242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.441901 6133 scope.go:122] "RemoveContainer" containerID="ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0" Oct 29 23:18:34.450108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.450087 6133 scope.go:122] "RemoveContainer" containerID="ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0" Oct 29 23:18:34.450365 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:18:34.450348 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0\": container with ID starting with ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0 not found: ID does not exist" containerID="ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0" Oct 29 23:18:34.450419 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.450373 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0"} err="failed to get container status \"ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0\": rpc error: code = NotFound desc = could not find container \"ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0\": container with ID starting with ed53aea4f1a4e796b9218247b54f3d2effd526cb3f9b5fd225e2239d8abef5c0 not found: ID does not exist" Oct 29 23:18:34.503853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.503832 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2"] Oct 29 23:18:34.515296 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:34.515260 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-ml8l2"] Oct 29 23:18:35.955863 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:35.955831 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd433e47-f072-44ef-aae8-ce01e70a8c2f" path="/var/lib/kubelet/pods/cd433e47-f072-44ef-aae8-ce01e70a8c2f/volumes" Oct 29 23:18:43.447485 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:18:43.447450 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:18:50.533978 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.533946 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-2jg9p"] Oct 29 23:18:50.534483 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.534391 6133 cpu_manager.go:414] "containerMap: removing container" podUID="cd433e47-f072-44ef-aae8-ce01e70a8c2f" containerName="manager" Oct 29 23:18:50.534483 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.534411 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd433e47-f072-44ef-aae8-ce01e70a8c2f" containerName="manager" Oct 29 23:18:50.534483 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.534483 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd433e47-f072-44ef-aae8-ce01e70a8c2f" containerName="manager" Oct 29 23:18:50.537685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.537670 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:50.553494 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.553472 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s8gcm\"" Oct 29 23:18:50.554908 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.554887 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-2jg9p"] Oct 29 23:18:50.689763 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.689736 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27cvx\" (UniqueName: \"kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx\") pod \"authorino-57f7f8659f-2jg9p\" (UID: \"2e38b2b7-5108-44b3-ad60-f8a27388ea18\") " pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:50.790204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.790155 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27cvx\" (UniqueName: \"kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx\") pod \"authorino-57f7f8659f-2jg9p\" (UID: \"2e38b2b7-5108-44b3-ad60-f8a27388ea18\") " pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:50.808162 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.808137 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27cvx\" (UniqueName: \"kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx\") pod \"authorino-57f7f8659f-2jg9p\" (UID: \"2e38b2b7-5108-44b3-ad60-f8a27388ea18\") " pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:50.847990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:50.847970 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:51.115359 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.115329 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:18:51.118491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.118470 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.137602 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.137578 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Oct 29 23:18:51.138161 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.138144 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hvkkc\"" Oct 29 23:18:51.138997 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.138980 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-2jg9p"] Oct 29 23:18:51.143631 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:51.143608 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e38b2b7_5108_44b3_ad60_f8a27388ea18.slice/crio-22754736e5518def4c29ea35f079f468f4f0022e234b0cc6ba5cbac65ac4326c WatchSource:0}: Error finding container 22754736e5518def4c29ea35f079f468f4f0022e234b0cc6ba5cbac65ac4326c: Status 404 returned error can't find the container with id 22754736e5518def4c29ea35f079f468f4f0022e234b0cc6ba5cbac65ac4326c Oct 29 23:18:51.144658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.144639 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:18:51.193777 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.193745 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3583c9a-51af-497b-af11-5d5f27525f05-config-file\") pod \"limitador-limitador-7c9b87d574-lhm9b\" (UID: \"a3583c9a-51af-497b-af11-5d5f27525f05\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.193885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.193797 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfzq8\" (UniqueName: \"kubernetes.io/projected/a3583c9a-51af-497b-af11-5d5f27525f05-kube-api-access-lfzq8\") pod \"limitador-limitador-7c9b87d574-lhm9b\" (UID: \"a3583c9a-51af-497b-af11-5d5f27525f05\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.204839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.204815 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:18:51.294375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.294347 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfzq8\" (UniqueName: \"kubernetes.io/projected/a3583c9a-51af-497b-af11-5d5f27525f05-kube-api-access-lfzq8\") pod \"limitador-limitador-7c9b87d574-lhm9b\" (UID: \"a3583c9a-51af-497b-af11-5d5f27525f05\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.294471 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.294416 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3583c9a-51af-497b-af11-5d5f27525f05-config-file\") pod \"limitador-limitador-7c9b87d574-lhm9b\" (UID: \"a3583c9a-51af-497b-af11-5d5f27525f05\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.294945 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.294928 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a3583c9a-51af-497b-af11-5d5f27525f05-config-file\") pod \"limitador-limitador-7c9b87d574-lhm9b\" (UID: \"a3583c9a-51af-497b-af11-5d5f27525f05\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.311945 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.311921 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfzq8\" (UniqueName: \"kubernetes.io/projected/a3583c9a-51af-497b-af11-5d5f27525f05-kube-api-access-lfzq8\") pod \"limitador-limitador-7c9b87d574-lhm9b\" (UID: \"a3583c9a-51af-497b-af11-5d5f27525f05\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.430872 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.430805 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:51.524261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.524231 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" event={"ID":"2e38b2b7-5108-44b3-ad60-f8a27388ea18","Type":"ContainerStarted","Data":"22754736e5518def4c29ea35f079f468f4f0022e234b0cc6ba5cbac65ac4326c"} Oct 29 23:18:51.721057 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:51.720952 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:18:51.725111 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:18:51.725085 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3583c9a_51af_497b_af11_5d5f27525f05.slice/crio-e437e1261b0b03a0caa08207c99bfbd647ad10577db3d21ecf1d6f8eeafa792a WatchSource:0}: Error finding container e437e1261b0b03a0caa08207c99bfbd647ad10577db3d21ecf1d6f8eeafa792a: Status 404 returned error can't find the container with id e437e1261b0b03a0caa08207c99bfbd647ad10577db3d21ecf1d6f8eeafa792a Oct 29 23:18:52.531300 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:52.531255 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" event={"ID":"a3583c9a-51af-497b-af11-5d5f27525f05","Type":"ContainerStarted","Data":"e437e1261b0b03a0caa08207c99bfbd647ad10577db3d21ecf1d6f8eeafa792a"} Oct 29 23:18:53.538145 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:53.538110 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" event={"ID":"2e38b2b7-5108-44b3-ad60-f8a27388ea18","Type":"ContainerStarted","Data":"3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58"} Oct 29 23:18:53.539727 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:53.539702 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" event={"ID":"a3583c9a-51af-497b-af11-5d5f27525f05","Type":"ContainerStarted","Data":"c3561bd0b6a206d7530d9467831d6239e734b5afa627182832bc410e541efa35"} Oct 29 23:18:53.539851 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:53.539748 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:18:53.575182 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:53.575137 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" podStartSLOduration=1.6209992930000001 podStartE2EDuration="3.575126246s" totalImagesPullingTime="1.954126953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:53.573760453 +0000 UTC m=+289.734948023" watchObservedRunningTime="2026-10-29 23:18:53.575126246 +0000 UTC m=+289.736313816" Oct 29 23:18:53.602140 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:53.602114 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-2jg9p"] Oct 29 23:18:53.612330 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:53.612265 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" podStartSLOduration=1.637381532 podStartE2EDuration="2.612243647s" totalImagesPullingTime="974.862115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:53.611628897 +0000 UTC m=+289.772816467" watchObservedRunningTime="2026-10-29 23:18:53.612243647 +0000 UTC m=+289.773431217" Oct 29 23:18:55.549218 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:55.549172 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" podUID="2e38b2b7-5108-44b3-ad60-f8a27388ea18" containerName="authorino" containerID="cri-o://3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58" gracePeriod=30 Oct 29 23:18:55.804860 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:55.804804 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:55.933436 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:55.933401 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx\" (UniqueName: \"kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx\") pod \"2e38b2b7-5108-44b3-ad60-f8a27388ea18\" (UID: \"2e38b2b7-5108-44b3-ad60-f8a27388ea18\") " Oct 29 23:18:55.935332 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:55.935306 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx" pod "2e38b2b7-5108-44b3-ad60-f8a27388ea18" (UID: "2e38b2b7-5108-44b3-ad60-f8a27388ea18"). InnerVolumeSpecName "kube-api-access-27cvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:18:56.033955 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.033918 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27cvx\" (UniqueName: \"kubernetes.io/projected/2e38b2b7-5108-44b3-ad60-f8a27388ea18-kube-api-access-27cvx\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:18:56.555175 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.555141 6133 generic.go:356] "Generic (PLEG): container finished" podID="2e38b2b7-5108-44b3-ad60-f8a27388ea18" containerID="3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58" exitCode=0 Oct 29 23:18:56.555645 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.555188 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" Oct 29 23:18:56.555645 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.555193 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" event={"ID":"2e38b2b7-5108-44b3-ad60-f8a27388ea18","Type":"ContainerDied","Data":"3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58"} Oct 29 23:18:56.555645 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.555239 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-2jg9p" event={"ID":"2e38b2b7-5108-44b3-ad60-f8a27388ea18","Type":"ContainerDied","Data":"22754736e5518def4c29ea35f079f468f4f0022e234b0cc6ba5cbac65ac4326c"} Oct 29 23:18:56.555645 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.555260 6133 scope.go:122] "RemoveContainer" containerID="3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58" Oct 29 23:18:56.563599 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.563581 6133 scope.go:122] "RemoveContainer" containerID="3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58" Oct 29 23:18:56.563838 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:18:56.563818 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58\": container with ID starting with 3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58 not found: ID does not exist" containerID="3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58" Oct 29 23:18:56.563909 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.563846 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58"} err="failed to get container status \"3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58\": rpc error: code = NotFound desc = could not find container \"3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58\": container with ID starting with 3d176badee3a0e0369343ff75e5e3d9c86f7ee34158ae50f1cfa779a04cf6f58 not found: ID does not exist" Oct 29 23:18:56.601031 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.601009 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-2jg9p"] Oct 29 23:18:56.612046 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:56.612026 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-2jg9p"] Oct 29 23:18:57.955844 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:18:57.955815 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e38b2b7-5108-44b3-ad60-f8a27388ea18" path="/var/lib/kubelet/pods/2e38b2b7-5108-44b3-ad60-f8a27388ea18/volumes" Oct 29 23:19:03.988923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:03.988901 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:19:03.995148 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:03.995121 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:19:04.546016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:04.545992 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-lhm9b" Oct 29 23:19:13.447094 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:19:13.447060 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:19:24.180071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.180033 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-tvn7p"] Oct 29 23:19:24.180584 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.180566 6133 cpu_manager.go:414] "containerMap: removing container" podUID="2e38b2b7-5108-44b3-ad60-f8a27388ea18" containerName="authorino" Oct 29 23:19:24.180655 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.180587 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e38b2b7-5108-44b3-ad60-f8a27388ea18" containerName="authorino" Oct 29 23:19:24.180709 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.180694 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e38b2b7-5108-44b3-ad60-f8a27388ea18" containerName="authorino" Oct 29 23:19:24.183877 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.183856 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.200920 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.200902 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rmlj6\"" Oct 29 23:19:24.209364 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.209343 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 29 23:19:24.209464 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.209406 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 29 23:19:24.211831 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.211811 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-tvn7p"] Oct 29 23:19:24.223317 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.223276 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc"] Oct 29 23:19:24.226630 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.226614 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.235909 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.235889 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Oct 29 23:19:24.246768 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.246749 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc"] Oct 29 23:19:24.255106 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.255082 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h26c8\" (UniqueName: \"kubernetes.io/projected/175bcc70-e853-4ad6-8535-552ab49374fb-kube-api-access-h26c8\") pod \"kserve-controller-manager-776cc66d47-tvn7p\" (UID: \"175bcc70-e853-4ad6-8535-552ab49374fb\") " pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.255209 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.255147 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59wcp\" (UniqueName: \"kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp\") pod \"llmisvc-controller-manager-869d5dcc5d-mllkc\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.255275 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.255231 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/175bcc70-e853-4ad6-8535-552ab49374fb-cert\") pod \"kserve-controller-manager-776cc66d47-tvn7p\" (UID: \"175bcc70-e853-4ad6-8535-552ab49374fb\") " pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.255275 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.255256 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-mllkc\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.262638 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.262619 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-hd4dh"] Oct 29 23:19:24.265849 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.265829 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.270475 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.270459 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Oct 29 23:19:24.270562 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.270476 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qc5w8\"" Oct 29 23:19:24.288186 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.288165 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-hd4dh"] Oct 29 23:19:24.302665 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.302646 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-vdtbl"] Oct 29 23:19:24.305925 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.305910 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.325968 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.325937 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-vdtbl"] Oct 29 23:19:24.335361 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.335341 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Oct 29 23:19:24.335455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.335352 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zd46p\"" Oct 29 23:19:24.335549 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.335532 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Oct 29 23:19:24.335600 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.335528 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Oct 29 23:19:24.335600 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.335551 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hwzv4\"" Oct 29 23:19:24.355956 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.355929 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-mllkc\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.356063 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.355987 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h26c8\" (UniqueName: \"kubernetes.io/projected/175bcc70-e853-4ad6-8535-552ab49374fb-kube-api-access-h26c8\") pod \"kserve-controller-manager-776cc66d47-tvn7p\" (UID: \"175bcc70-e853-4ad6-8535-552ab49374fb\") " pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.356063 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356055 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ec1993-37cf-4d6f-902d-a2ca98b80cd0-tls-certs\") pod \"model-serving-api-75bd89fdfc-hd4dh\" (UID: \"90ec1993-37cf-4d6f-902d-a2ca98b80cd0\") " pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.356181 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356093 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrxwq\" (UniqueName: \"kubernetes.io/projected/90ec1993-37cf-4d6f-902d-a2ca98b80cd0-kube-api-access-rrxwq\") pod \"model-serving-api-75bd89fdfc-hd4dh\" (UID: \"90ec1993-37cf-4d6f-902d-a2ca98b80cd0\") " pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.356181 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356121 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw2vv\" (UniqueName: \"kubernetes.io/projected/0a40e800-3874-4706-9ebb-ade608697967-kube-api-access-kw2vv\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.356312 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356235 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a40e800-3874-4706-9ebb-ade608697967-cert\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.356312 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356269 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a40e800-3874-4706-9ebb-ade608697967-metrics-certs\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.356426 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356338 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59wcp\" (UniqueName: \"kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp\") pod \"llmisvc-controller-manager-869d5dcc5d-mllkc\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.356426 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.356371 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/175bcc70-e853-4ad6-8535-552ab49374fb-cert\") pod \"kserve-controller-manager-776cc66d47-tvn7p\" (UID: \"175bcc70-e853-4ad6-8535-552ab49374fb\") " pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.358529 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.358506 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-mllkc\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.358836 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.358815 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/175bcc70-e853-4ad6-8535-552ab49374fb-cert\") pod \"kserve-controller-manager-776cc66d47-tvn7p\" (UID: \"175bcc70-e853-4ad6-8535-552ab49374fb\") " pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.373517 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.373494 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59wcp\" (UniqueName: \"kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp\") pod \"llmisvc-controller-manager-869d5dcc5d-mllkc\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.373784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.373764 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h26c8\" (UniqueName: \"kubernetes.io/projected/175bcc70-e853-4ad6-8535-552ab49374fb-kube-api-access-h26c8\") pod \"kserve-controller-manager-776cc66d47-tvn7p\" (UID: \"175bcc70-e853-4ad6-8535-552ab49374fb\") " pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.457660 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.457607 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ec1993-37cf-4d6f-902d-a2ca98b80cd0-tls-certs\") pod \"model-serving-api-75bd89fdfc-hd4dh\" (UID: \"90ec1993-37cf-4d6f-902d-a2ca98b80cd0\") " pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.457660 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.457641 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrxwq\" (UniqueName: \"kubernetes.io/projected/90ec1993-37cf-4d6f-902d-a2ca98b80cd0-kube-api-access-rrxwq\") pod \"model-serving-api-75bd89fdfc-hd4dh\" (UID: \"90ec1993-37cf-4d6f-902d-a2ca98b80cd0\") " pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.457789 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.457661 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw2vv\" (UniqueName: \"kubernetes.io/projected/0a40e800-3874-4706-9ebb-ade608697967-kube-api-access-kw2vv\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.457789 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.457701 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a40e800-3874-4706-9ebb-ade608697967-cert\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.457789 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.457725 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a40e800-3874-4706-9ebb-ade608697967-metrics-certs\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.459797 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.459777 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90ec1993-37cf-4d6f-902d-a2ca98b80cd0-tls-certs\") pod \"model-serving-api-75bd89fdfc-hd4dh\" (UID: \"90ec1993-37cf-4d6f-902d-a2ca98b80cd0\") " pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.459916 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.459898 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a40e800-3874-4706-9ebb-ade608697967-metrics-certs\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.460055 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.460037 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a40e800-3874-4706-9ebb-ade608697967-cert\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.476810 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.476791 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw2vv\" (UniqueName: \"kubernetes.io/projected/0a40e800-3874-4706-9ebb-ade608697967-kube-api-access-kw2vv\") pod \"odh-model-controller-769875db56-vdtbl\" (UID: \"0a40e800-3874-4706-9ebb-ade608697967\") " pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.476974 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.476956 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrxwq\" (UniqueName: \"kubernetes.io/projected/90ec1993-37cf-4d6f-902d-a2ca98b80cd0-kube-api-access-rrxwq\") pod \"model-serving-api-75bd89fdfc-hd4dh\" (UID: \"90ec1993-37cf-4d6f-902d-a2ca98b80cd0\") " pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.495633 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.495612 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:24.537707 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.537678 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:24.577384 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.577353 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:24.618663 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.618640 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:24.788694 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.788624 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-tvn7p"] Oct 29 23:19:24.792590 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:19:24.792564 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175bcc70_e853_4ad6_8535_552ab49374fb.slice/crio-73e9eb31f42c607803665f055e951b301b1c751929f269ee57ef785c884c8bf7 WatchSource:0}: Error finding container 73e9eb31f42c607803665f055e951b301b1c751929f269ee57ef785c884c8bf7: Status 404 returned error can't find the container with id 73e9eb31f42c607803665f055e951b301b1c751929f269ee57ef785c884c8bf7 Oct 29 23:19:24.837361 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.837334 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc"] Oct 29 23:19:24.841272 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:19:24.841245 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podccfd67a1_19b7_4e58_90ba_d1d3c7755d44.slice/crio-c1966950f06488cb3b19c75061342959d47c69a7ce7ab7c373f9df54ff2c1c5b WatchSource:0}: Error finding container c1966950f06488cb3b19c75061342959d47c69a7ce7ab7c373f9df54ff2c1c5b: Status 404 returned error can't find the container with id c1966950f06488cb3b19c75061342959d47c69a7ce7ab7c373f9df54ff2c1c5b Oct 29 23:19:24.881014 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.880989 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-hd4dh"] Oct 29 23:19:24.884425 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:19:24.884404 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ec1993_37cf_4d6f_902d_a2ca98b80cd0.slice/crio-b6816d1ec031cf500f701e38ac3f80ccf80a91a1a465bbb04cea76cd7afe1551 WatchSource:0}: Error finding container b6816d1ec031cf500f701e38ac3f80ccf80a91a1a465bbb04cea76cd7afe1551: Status 404 returned error can't find the container with id b6816d1ec031cf500f701e38ac3f80ccf80a91a1a465bbb04cea76cd7afe1551 Oct 29 23:19:24.915961 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:24.915942 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-vdtbl"] Oct 29 23:19:24.919848 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:19:24.919823 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a40e800_3874_4706_9ebb_ade608697967.slice/crio-74dff9043f99a0518000c1f2fd2239c88ceac47d61db6e22e0703eeb687249ee WatchSource:0}: Error finding container 74dff9043f99a0518000c1f2fd2239c88ceac47d61db6e22e0703eeb687249ee: Status 404 returned error can't find the container with id 74dff9043f99a0518000c1f2fd2239c88ceac47d61db6e22e0703eeb687249ee Oct 29 23:19:25.705357 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:25.705212 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-vdtbl" event={"ID":"0a40e800-3874-4706-9ebb-ade608697967","Type":"ContainerStarted","Data":"74dff9043f99a0518000c1f2fd2239c88ceac47d61db6e22e0703eeb687249ee"} Oct 29 23:19:25.709816 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:25.709783 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" event={"ID":"175bcc70-e853-4ad6-8535-552ab49374fb","Type":"ContainerStarted","Data":"73e9eb31f42c607803665f055e951b301b1c751929f269ee57ef785c884c8bf7"} Oct 29 23:19:25.712607 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:25.712574 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" event={"ID":"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44","Type":"ContainerStarted","Data":"c1966950f06488cb3b19c75061342959d47c69a7ce7ab7c373f9df54ff2c1c5b"} Oct 29 23:19:25.716298 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:25.716254 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" event={"ID":"90ec1993-37cf-4d6f-902d-a2ca98b80cd0","Type":"ContainerStarted","Data":"b6816d1ec031cf500f701e38ac3f80ccf80a91a1a465bbb04cea76cd7afe1551"} Oct 29 23:19:28.735517 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.735410 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" event={"ID":"90ec1993-37cf-4d6f-902d-a2ca98b80cd0","Type":"ContainerStarted","Data":"19ca04e9b8d5d6e5b4e0308aa5c310bdd084593a2ebd40c71d19f961d0ceee19"} Oct 29 23:19:28.735945 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.735575 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:28.737167 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.737137 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-vdtbl" event={"ID":"0a40e800-3874-4706-9ebb-ade608697967","Type":"ContainerStarted","Data":"1f4b74057255cc82d9b934c75cf9db46dbe09dfa917695b27e0e448b8db882af"} Oct 29 23:19:28.737315 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.737215 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:28.738764 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.738744 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" event={"ID":"175bcc70-e853-4ad6-8535-552ab49374fb","Type":"ContainerStarted","Data":"2d83d38a59fc77978b174a021dd8f3fa0c065eec5c2c6e07a94c89d3900df4c3"} Oct 29 23:19:28.738856 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.738795 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:19:28.740184 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.740162 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" event={"ID":"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44","Type":"ContainerStarted","Data":"4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6"} Oct 29 23:19:28.740312 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.740292 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:28.774822 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.774781 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" podStartSLOduration=1.987336558 podStartE2EDuration="4.774769223s" totalImagesPullingTime="2.787432665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:28.773019365 +0000 UTC m=+324.934206934" watchObservedRunningTime="2026-10-29 23:19:28.774769223 +0000 UTC m=+324.935956791" Oct 29 23:19:28.810725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.810685 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" podStartSLOduration=1.871198208 podStartE2EDuration="4.810673538s" totalImagesPullingTime="2.93947533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:28.8090246 +0000 UTC m=+324.970212169" watchObservedRunningTime="2026-10-29 23:19:28.810673538 +0000 UTC m=+324.971861108" Oct 29 23:19:28.848607 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.848566 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-vdtbl" podStartSLOduration=1.32944428 podStartE2EDuration="4.848552389s" totalImagesPullingTime="3.519108109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:28.846451455 +0000 UTC m=+325.007639025" watchObservedRunningTime="2026-10-29 23:19:28.848552389 +0000 UTC m=+325.009739962" Oct 29 23:19:28.884010 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:28.883968 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" podStartSLOduration=2.04468978 podStartE2EDuration="4.883958831s" totalImagesPullingTime="2.839269051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:19:28.883242122 +0000 UTC m=+325.044429691" watchObservedRunningTime="2026-10-29 23:19:28.883958831 +0000 UTC m=+325.045146400" Oct 29 23:19:39.748480 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:39.748453 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-vdtbl" Oct 29 23:19:39.755754 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:39.755733 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-hd4dh" Oct 29 23:19:43.447651 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:19:43.447603 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:19:59.747653 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:59.747614 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:19:59.750885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:19:59.750859 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-tvn7p" Oct 29 23:20:04.273169 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:04.273130 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:20:12.862255 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.862221 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-f6zjf"] Oct 29 23:20:12.875034 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.875007 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:12.889693 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.888914 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-f6zjf"] Oct 29 23:20:12.897697 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.897662 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Oct 29 23:20:12.903878 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.903852 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-s8gcm\"" Oct 29 23:20:12.962620 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.962597 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert\") pod \"authorino-6889cbd8c4-f6zjf\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:12.964624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.962642 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rfzr\" (UniqueName: \"kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr\") pod \"authorino-6889cbd8c4-f6zjf\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:12.996438 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:12.996411 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-f6zjf"] Oct 29 23:20:12.996676 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:20:12.996645 6133 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6rfzr tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" podUID="7a94ae75-dd63-4954-837f-359800eade50" Oct 29 23:20:13.063077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.063047 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rfzr\" (UniqueName: \"kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr\") pod \"authorino-6889cbd8c4-f6zjf\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:13.063196 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.063148 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert\") pod \"authorino-6889cbd8c4-f6zjf\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:13.065363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.065344 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert\") pod \"authorino-6889cbd8c4-f6zjf\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:13.081757 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.081726 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rfzr\" (UniqueName: \"kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr\") pod \"authorino-6889cbd8c4-f6zjf\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:13.447123 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:20:13.447062 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:20:13.965311 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.965259 6133 generic.go:356] "Generic (PLEG): container finished" podID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerID="275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc" exitCode=0 Oct 29 23:20:13.965791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.965306 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" event={"ID":"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19","Type":"ContainerDied","Data":"275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc"} Oct 29 23:20:13.965791 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.965399 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:13.965915 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.965862 6133 scope.go:122] "RemoveContainer" containerID="275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc" Oct 29 23:20:13.967036 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.967008 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:20:13.967133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.967071 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:20:13.967133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.967103 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:20:13.973729 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:13.973711 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:14.070752 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.070722 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert\" (UniqueName: \"kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert\") pod \"7a94ae75-dd63-4954-837f-359800eade50\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " Oct 29 23:20:14.070911 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.070772 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr\" (UniqueName: \"kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr\") pod \"7a94ae75-dd63-4954-837f-359800eade50\" (UID: \"7a94ae75-dd63-4954-837f-359800eade50\") " Oct 29 23:20:14.073143 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.073112 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr" pod "7a94ae75-dd63-4954-837f-359800eade50" (UID: "7a94ae75-dd63-4954-837f-359800eade50"). InnerVolumeSpecName "kube-api-access-6rfzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:20:14.073307 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.073261 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert" pod "7a94ae75-dd63-4954-837f-359800eade50" (UID: "7a94ae75-dd63-4954-837f-359800eade50"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:20:14.172074 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.172048 6133 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7a94ae75-dd63-4954-837f-359800eade50-tls-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:20:14.172074 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.172073 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rfzr\" (UniqueName: \"kubernetes.io/projected/7a94ae75-dd63-4954-837f-359800eade50-kube-api-access-6rfzr\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:20:14.993364 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.992868 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-f6zjf" Oct 29 23:20:15.002302 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:14.994529 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" event={"ID":"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19","Type":"ContainerStarted","Data":"2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94"} Oct 29 23:20:15.138891 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:15.138856 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-f6zjf"] Oct 29 23:20:15.142465 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:15.142440 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-f6zjf"] Oct 29 23:20:15.784682 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:15.784649 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:20:15.785022 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:15.784997 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-j2mw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Oct 29 23:20:15.785184 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:15.785155 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Oct 29 23:20:15.956999 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:15.956964 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7a94ae75-dd63-4954-837f-359800eade50" path="/var/lib/kubelet/pods/7a94ae75-dd63-4954-837f-359800eade50/volumes" Oct 29 23:20:16.789307 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:16.785614 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-j2mw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Oct 29 23:20:16.789307 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:16.785671 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Oct 29 23:20:17.790307 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:17.785691 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-j2mw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Oct 29 23:20:17.790307 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:17.785763 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Oct 29 23:20:18.777309 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:18.775633 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-j2mw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Oct 29 23:20:18.777309 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:18.775692 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Oct 29 23:20:19.776157 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:19.776123 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-j2mw9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Oct 29 23:20:19.776602 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:19.776175 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Oct 29 23:20:19.804414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:19.804385 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:20:20.779618 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:20.779591 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:20:20.780659 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:20.780638 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:20:36.031546 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.031513 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f"] Oct 29 23:20:36.035272 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.035252 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.053505 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.053482 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f"] Oct 29 23:20:36.184783 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.184757 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18076c98-63e2-417c-ab52-65141215e258-cert\") pod \"llmisvc-controller-manager-6466c554d8-mzd8f\" (UID: \"18076c98-63e2-417c-ab52-65141215e258\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.184899 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.184800 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g59ct\" (UniqueName: \"kubernetes.io/projected/18076c98-63e2-417c-ab52-65141215e258-kube-api-access-g59ct\") pod \"llmisvc-controller-manager-6466c554d8-mzd8f\" (UID: \"18076c98-63e2-417c-ab52-65141215e258\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.285394 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.285330 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18076c98-63e2-417c-ab52-65141215e258-cert\") pod \"llmisvc-controller-manager-6466c554d8-mzd8f\" (UID: \"18076c98-63e2-417c-ab52-65141215e258\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.285394 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.285380 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g59ct\" (UniqueName: \"kubernetes.io/projected/18076c98-63e2-417c-ab52-65141215e258-kube-api-access-g59ct\") pod \"llmisvc-controller-manager-6466c554d8-mzd8f\" (UID: \"18076c98-63e2-417c-ab52-65141215e258\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.287680 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.287654 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/18076c98-63e2-417c-ab52-65141215e258-cert\") pod \"llmisvc-controller-manager-6466c554d8-mzd8f\" (UID: \"18076c98-63e2-417c-ab52-65141215e258\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.303426 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.303404 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g59ct\" (UniqueName: \"kubernetes.io/projected/18076c98-63e2-417c-ab52-65141215e258-kube-api-access-g59ct\") pod \"llmisvc-controller-manager-6466c554d8-mzd8f\" (UID: \"18076c98-63e2-417c-ab52-65141215e258\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.347400 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.347379 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:36.639168 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:36.639140 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f"] Oct 29 23:20:36.643020 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:20:36.642996 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18076c98_63e2_417c_ab52_65141215e258.slice/crio-47ad585a94f3b2bf552e3289a5819aaf29f5a107a820c6cb55fb787f0d604248 WatchSource:0}: Error finding container 47ad585a94f3b2bf552e3289a5819aaf29f5a107a820c6cb55fb787f0d604248: Status 404 returned error can't find the container with id 47ad585a94f3b2bf552e3289a5819aaf29f5a107a820c6cb55fb787f0d604248 Oct 29 23:20:37.103606 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:37.103577 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" event={"ID":"18076c98-63e2-417c-ab52-65141215e258","Type":"ContainerStarted","Data":"4449aa2d3332c981c07939321f8a6a2b480c23f670766590d51b097ba62b45d1"} Oct 29 23:20:37.104036 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:37.103636 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" event={"ID":"18076c98-63e2-417c-ab52-65141215e258","Type":"ContainerStarted","Data":"47ad585a94f3b2bf552e3289a5819aaf29f5a107a820c6cb55fb787f0d604248"} Oct 29 23:20:37.104036 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:37.103666 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:20:37.140892 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:20:37.140844 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" podStartSLOduration=0.796075916 podStartE2EDuration="1.140830819s" totalImagesPullingTime="344.754903ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:20:37.139465007 +0000 UTC m=+393.300652577" watchObservedRunningTime="2026-10-29 23:20:37.140830819 +0000 UTC m=+393.302018388" Oct 29 23:20:43.449522 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:20:43.449484 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:21:08.112109 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.112076 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-mzd8f" Oct 29 23:21:08.177679 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.177640 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc"] Oct 29 23:21:08.177940 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.177910 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" podUID="ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" containerName="manager" containerID="cri-o://4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6" gracePeriod=30 Oct 29 23:21:08.421902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.421879 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:21:08.435555 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.435532 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert\" (UniqueName: \"kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert\") pod \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " Oct 29 23:21:08.435696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.435573 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp\" (UniqueName: \"kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp\") pod \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\" (UID: \"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44\") " Oct 29 23:21:08.437561 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.437536 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert" pod "ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" (UID: "ccfd67a1-19b7-4e58-90ba-d1d3c7755d44"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:21:08.437696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.437682 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp" pod "ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" (UID: "ccfd67a1-19b7-4e58-90ba-d1d3c7755d44"). InnerVolumeSpecName "kube-api-access-59wcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:21:08.536770 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.536746 6133 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:21:08.536770 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:08.536769 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59wcp\" (UniqueName: \"kubernetes.io/projected/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44-kube-api-access-59wcp\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:21:09.266387 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.266357 6133 generic.go:356] "Generic (PLEG): container finished" podID="ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" containerID="4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6" exitCode=0 Oct 29 23:21:09.266773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.266399 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" Oct 29 23:21:09.266773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.266434 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" event={"ID":"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44","Type":"ContainerDied","Data":"4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6"} Oct 29 23:21:09.266773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.266487 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc" event={"ID":"ccfd67a1-19b7-4e58-90ba-d1d3c7755d44","Type":"ContainerDied","Data":"c1966950f06488cb3b19c75061342959d47c69a7ce7ab7c373f9df54ff2c1c5b"} Oct 29 23:21:09.266773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.266509 6133 scope.go:122] "RemoveContainer" containerID="4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6" Oct 29 23:21:09.275698 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.275669 6133 scope.go:122] "RemoveContainer" containerID="4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6" Oct 29 23:21:09.275950 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:21:09.275931 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6\": container with ID starting with 4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6 not found: ID does not exist" containerID="4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6" Oct 29 23:21:09.276012 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.275962 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6"} err="failed to get container status \"4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6\": rpc error: code = NotFound desc = could not find container \"4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6\": container with ID starting with 4d54b2a0adba2e394d5fbfa189a523d6d3d826852c429b0fa120a3cdbb1c6ce6 not found: ID does not exist" Oct 29 23:21:09.313616 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.313596 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc"] Oct 29 23:21:09.319705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.319661 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-mllkc"] Oct 29 23:21:09.955837 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:09.955807 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" path="/var/lib/kubelet/pods/ccfd67a1-19b7-4e58-90ba-d1d3c7755d44/volumes" Oct 29 23:21:13.448339 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:21:13.448308 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:21:43.448690 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:21:43.448655 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:21:45.670511 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:45.668209 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:21:49.316339 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:49.316302 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:21:52.897783 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:52.897751 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:21:56.712026 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:21:56.711987 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:22:02.255420 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:02.255385 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:22:13.447872 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:22:13.447831 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:22:39.388123 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.388049 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8"] Oct 29 23:22:39.388596 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.388559 6133 cpu_manager.go:414] "containerMap: removing container" podUID="ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" containerName="manager" Oct 29 23:22:39.388596 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.388574 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" containerName="manager" Oct 29 23:22:39.388668 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.388638 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="ccfd67a1-19b7-4e58-90ba-d1d3c7755d44" containerName="manager" Oct 29 23:22:39.391648 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.391632 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.418900 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.418871 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8"] Oct 29 23:22:39.478223 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478194 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe40a474-984c-4ba2-bdce-0e90acd49bff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478378 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478234 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478378 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478255 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478474 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478404 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478474 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478444 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478474 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478466 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478571 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478552 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478621 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478607 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzv8f\" (UniqueName: \"kubernetes.io/projected/fe40a474-984c-4ba2-bdce-0e90acd49bff-kube-api-access-rzv8f\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.478655 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.478636 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579524 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579489 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe40a474-984c-4ba2-bdce-0e90acd49bff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579524 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579530 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579549 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579581 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579605 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579623 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579639 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579664 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzv8f\" (UniqueName: \"kubernetes.io/projected/fe40a474-984c-4ba2-bdce-0e90acd49bff-kube-api-access-rzv8f\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.579952 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.579933 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.580034 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.580011 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.580113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.580091 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.580178 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.580148 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.580178 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.580169 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.580265 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.580249 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe40a474-984c-4ba2-bdce-0e90acd49bff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.582207 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.582185 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.582369 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.582354 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.598093 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.598073 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe40a474-984c-4ba2-bdce-0e90acd49bff-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.598329 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.598312 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzv8f\" (UniqueName: \"kubernetes.io/projected/fe40a474-984c-4ba2-bdce-0e90acd49bff-kube-api-access-rzv8f\") pod \"maas-default-gateway-openshift-default-7d9897b54c-4jwf8\" (UID: \"fe40a474-984c-4ba2-bdce-0e90acd49bff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:39.709403 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:39.709354 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:40.020615 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.020540 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8"] Oct 29 23:22:40.023712 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:22:40.023688 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe40a474_984c_4ba2_bdce_0e90acd49bff.slice/crio-7522bf28ae8c63f9c36a7bcd61d4fc62f2fdb6ddeba16508818750e7b9549a0c WatchSource:0}: Error finding container 7522bf28ae8c63f9c36a7bcd61d4fc62f2fdb6ddeba16508818750e7b9549a0c: Status 404 returned error can't find the container with id 7522bf28ae8c63f9c36a7bcd61d4fc62f2fdb6ddeba16508818750e7b9549a0c Oct 29 23:22:40.025589 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.025560 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:22:40.025644 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.025625 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:22:40.025683 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.025655 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:22:40.741941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.741897 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" event={"ID":"fe40a474-984c-4ba2-bdce-0e90acd49bff","Type":"ContainerStarted","Data":"c88c66a6591ee7687c5b5df018aa2fc08351c9b7b661009d6375e8330f8b84f7"} Oct 29 23:22:40.742373 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.741961 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" event={"ID":"fe40a474-984c-4ba2-bdce-0e90acd49bff","Type":"ContainerStarted","Data":"7522bf28ae8c63f9c36a7bcd61d4fc62f2fdb6ddeba16508818750e7b9549a0c"} Oct 29 23:22:40.808500 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:40.808438 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podStartSLOduration=1.808421669 podStartE2EDuration="1.808421669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:40.806998462 +0000 UTC m=+516.968186032" watchObservedRunningTime="2026-10-29 23:22:40.808421669 +0000 UTC m=+516.969609299" Oct 29 23:22:41.709812 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:41.709778 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:41.711135 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:41.711105 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-4jwf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:22:41.711261 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:41.711151 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podUID="fe40a474-984c-4ba2-bdce-0e90acd49bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Oct 29 23:22:42.709685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:42.709650 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-4jwf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:22:42.710072 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:42.709701 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podUID="fe40a474-984c-4ba2-bdce-0e90acd49bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Oct 29 23:22:43.449086 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:22:43.449055 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:22:43.709784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:43.709706 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-4jwf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:22:43.709784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:43.709762 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podUID="fe40a474-984c-4ba2-bdce-0e90acd49bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Oct 29 23:22:44.710607 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:44.710565 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-4jwf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:22:44.711169 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:44.710627 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podUID="fe40a474-984c-4ba2-bdce-0e90acd49bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Oct 29 23:22:45.709730 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:45.709697 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-4jwf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:22:45.709889 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:45.709756 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podUID="fe40a474-984c-4ba2-bdce-0e90acd49bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Oct 29 23:22:46.709883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:46.709846 6133 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-4jwf8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Oct 29 23:22:46.710388 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:46.709903 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" podUID="fe40a474-984c-4ba2-bdce-0e90acd49bff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Oct 29 23:22:48.301958 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:48.301926 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:48.302455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:48.302326 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:48.303200 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:48.303177 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-4jwf8" Oct 29 23:22:53.746397 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:53.746365 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:22:57.358558 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.358516 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:22:57.806942 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.806900 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2"] Oct 29 23:22:57.810533 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.810504 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:57.828388 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.828362 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2"] Oct 29 23:22:57.851738 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.851705 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume\") pod \"payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:57.851906 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.851757 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdsr\" (UniqueName: \"kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr\") pod \"payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:57.869947 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.869918 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-83198dc0\"" Oct 29 23:22:57.870116 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.870102 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-83198dc0-dockercfg-2c6fq\"" Oct 29 23:22:57.952433 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.952386 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume\") pod \"payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:57.952592 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.952461 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdsr\" (UniqueName: \"kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr\") pod \"payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:57.953349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.953321 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume\") pod \"payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:57.971638 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:57.971610 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdsr\" (UniqueName: \"kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr\") pod \"payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:58.124903 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:58.124875 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:22:58.417073 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:58.416992 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2"] Oct 29 23:22:58.421782 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:22:58.421755 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2e3d58_c3b5_4425_b205_9eb6b165f886.slice/crio-b79db3035c4bf819de5ca78adfb7aec73f22d99996b4f114fcd4f25cc598fd55 WatchSource:0}: Error finding container b79db3035c4bf819de5ca78adfb7aec73f22d99996b4f114fcd4f25cc598fd55: Status 404 returned error can't find the container with id b79db3035c4bf819de5ca78adfb7aec73f22d99996b4f114fcd4f25cc598fd55 Oct 29 23:22:58.423762 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:58.423746 6133 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 29 23:22:58.852258 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:22:58.852174 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" event={"ID":"5f2e3d58-c3b5-4425-b205-9eb6b165f886","Type":"ContainerStarted","Data":"b79db3035c4bf819de5ca78adfb7aec73f22d99996b4f114fcd4f25cc598fd55"} Oct 29 23:23:00.865697 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:00.865657 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" event={"ID":"5f2e3d58-c3b5-4425-b205-9eb6b165f886","Type":"ContainerStarted","Data":"da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353"} Oct 29 23:23:00.866079 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:00.865729 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:23:00.905377 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:00.905318 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" podStartSLOduration=1.823200527 podStartE2EDuration="3.905300767s" totalImagesPullingTime="2.08210024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:00.903702251 +0000 UTC m=+537.064889822" watchObservedRunningTime="2026-10-29 23:23:00.905300767 +0000 UTC m=+537.066488338" Oct 29 23:23:02.857005 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:02.856948 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:23:07.569995 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.569958 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr"] Oct 29 23:23:07.573988 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.573967 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.590916 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.590893 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:23:07.590916 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.590901 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:23:07.602022 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.602002 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:23:07.602170 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.602022 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:23:07.603946 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.603925 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr"] Oct 29 23:23:07.643862 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.643841 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.643972 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.643906 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxfld\" (UniqueName: \"kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.644057 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.644036 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.744850 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.744824 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxfld\" (UniqueName: \"kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.744948 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.744866 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.744948 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.744892 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.745586 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.745567 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.747164 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.747136 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.765362 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.765339 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxfld\" (UniqueName: \"kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld\") pod \"maas-api-revoke-keys-e2e-ait-46444d59-jp6nr\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.885845 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.885824 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:07.998251 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:07.998223 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p"] Oct 29 23:23:08.004013 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.003990 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.021058 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.021029 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p"] Oct 29 23:23:08.047832 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.047802 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzbjv\" (UniqueName: \"kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.047962 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.047940 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.048027 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.047971 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.148548 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.148470 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.148548 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.148512 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.148773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.148585 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzbjv\" (UniqueName: \"kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.149138 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.149113 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.150848 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.150825 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.168740 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.168713 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzbjv\" (UniqueName: \"kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv\") pod \"maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.181429 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.181404 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr"] Oct 29 23:23:08.184317 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:23:08.184273 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5afda5_ee67_457c_b596_e856e821e0c6.slice/crio-2e2e9493a05a5ea0214684b4118a684e1a52cc1742181133297dd60daeaa1f80 WatchSource:0}: Error finding container 2e2e9493a05a5ea0214684b4118a684e1a52cc1742181133297dd60daeaa1f80: Status 404 returned error can't find the container with id 2e2e9493a05a5ea0214684b4118a684e1a52cc1742181133297dd60daeaa1f80 Oct 29 23:23:08.326948 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.326922 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:08.619526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.619491 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p"] Oct 29 23:23:08.623235 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:23:08.623208 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6881c0_cb8a_4da4_9d02_66455a23bbe1.slice/crio-8fff60a9d04dbcf38860f3396c8a23db80e2d46abefd278f959954dc676c59ca WatchSource:0}: Error finding container 8fff60a9d04dbcf38860f3396c8a23db80e2d46abefd278f959954dc676c59ca: Status 404 returned error can't find the container with id 8fff60a9d04dbcf38860f3396c8a23db80e2d46abefd278f959954dc676c59ca Oct 29 23:23:08.914335 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.914236 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" event={"ID":"0c6881c0-cb8a-4da4-9d02-66455a23bbe1","Type":"ContainerStarted","Data":"8fff60a9d04dbcf38860f3396c8a23db80e2d46abefd278f959954dc676c59ca"} Oct 29 23:23:08.916065 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:08.916038 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" event={"ID":"7d5afda5-ee67-457c-b596-e856e821e0c6","Type":"ContainerStarted","Data":"2e2e9493a05a5ea0214684b4118a684e1a52cc1742181133297dd60daeaa1f80"} Oct 29 23:23:10.142248 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:10.141435 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:23:10.930686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:10.930647 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" event={"ID":"7d5afda5-ee67-457c-b596-e856e821e0c6","Type":"ContainerStarted","Data":"3fd31f1763285a26276566575e7e7c709a2380e9913fc9bf27bcbf06d216ea6d"} Oct 29 23:23:10.968597 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:10.968550 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" podStartSLOduration=1.7980803440000002 podStartE2EDuration="3.968535756s" totalImagesPullingTime="2.170455412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:10.967716007 +0000 UTC m=+547.128903578" watchObservedRunningTime="2026-10-29 23:23:10.968535756 +0000 UTC m=+547.129723326" Oct 29 23:23:11.874932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:11.874901 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:23:11.938629 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:11.938593 6133 generic.go:356] "Generic (PLEG): container finished" podID="7d5afda5-ee67-457c-b596-e856e821e0c6" containerID="3fd31f1763285a26276566575e7e7c709a2380e9913fc9bf27bcbf06d216ea6d" exitCode=0 Oct 29 23:23:11.938807 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:11.938653 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" event={"ID":"7d5afda5-ee67-457c-b596-e856e821e0c6","Type":"ContainerDied","Data":"3fd31f1763285a26276566575e7e7c709a2380e9913fc9bf27bcbf06d216ea6d"} Oct 29 23:23:11.940380 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:11.940351 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" event={"ID":"0c6881c0-cb8a-4da4-9d02-66455a23bbe1","Type":"ContainerStarted","Data":"4a18c4c82fb401d924a3081308995db95b91bc9d7f230dc8731bec7a7ef17315"} Oct 29 23:23:12.020098 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:12.020048 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" podStartSLOduration=2.589384719 podStartE2EDuration="5.020034917s" totalImagesPullingTime="2.430650198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:12.018469809 +0000 UTC m=+548.179657379" watchObservedRunningTime="2026-10-29 23:23:12.020034917 +0000 UTC m=+548.181222496" Oct 29 23:23:12.947114 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:12.947063 6133 generic.go:356] "Generic (PLEG): container finished" podID="0c6881c0-cb8a-4da4-9d02-66455a23bbe1" containerID="4a18c4c82fb401d924a3081308995db95b91bc9d7f230dc8731bec7a7ef17315" exitCode=0 Oct 29 23:23:12.947517 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:12.947209 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" event={"ID":"0c6881c0-cb8a-4da4-9d02-66455a23bbe1","Type":"ContainerDied","Data":"4a18c4c82fb401d924a3081308995db95b91bc9d7f230dc8731bec7a7ef17315"} Oct 29 23:23:13.087534 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.087514 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:13.193812 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.193785 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld\" (UniqueName: \"kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld\") pod \"7d5afda5-ee67-457c-b596-e856e821e0c6\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " Oct 29 23:23:13.193975 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.193880 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca\") pod \"7d5afda5-ee67-457c-b596-e856e821e0c6\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " Oct 29 23:23:13.193975 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.193922 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca\") pod \"7d5afda5-ee67-457c-b596-e856e821e0c6\" (UID: \"7d5afda5-ee67-457c-b596-e856e821e0c6\") " Oct 29 23:23:13.194248 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.194225 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca" pod "7d5afda5-ee67-457c-b596-e856e821e0c6" (UID: "7d5afda5-ee67-457c-b596-e856e821e0c6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:13.196002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.195979 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld" pod "7d5afda5-ee67-457c-b596-e856e821e0c6" (UID: "7d5afda5-ee67-457c-b596-e856e821e0c6"). InnerVolumeSpecName "kube-api-access-pxfld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:13.196100 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.195980 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca" pod "7d5afda5-ee67-457c-b596-e856e821e0c6" (UID: "7d5afda5-ee67-457c-b596-e856e821e0c6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:13.294830 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.294796 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:13.294830 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.294826 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxfld\" (UniqueName: \"kubernetes.io/projected/7d5afda5-ee67-457c-b596-e856e821e0c6-kube-api-access-pxfld\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:13.294996 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.294840 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7d5afda5-ee67-457c-b596-e856e821e0c6-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:13.447910 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:23:13.447877 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:23:13.954688 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.954646 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" Oct 29 23:23:13.956751 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.956722 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr" event={"ID":"7d5afda5-ee67-457c-b596-e856e821e0c6","Type":"ContainerDied","Data":"2e2e9493a05a5ea0214684b4118a684e1a52cc1742181133297dd60daeaa1f80"} Oct 29 23:23:13.956876 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:13.956771 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e2e9493a05a5ea0214684b4118a684e1a52cc1742181133297dd60daeaa1f80" Oct 29 23:23:14.096213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.096185 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:14.202580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.202555 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv\" (UniqueName: \"kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv\") pod \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " Oct 29 23:23:14.202580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.202593 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca\") pod \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " Oct 29 23:23:14.202813 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.202641 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca\") pod \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\" (UID: \"0c6881c0-cb8a-4da4-9d02-66455a23bbe1\") " Oct 29 23:23:14.202994 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.202961 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca" pod "0c6881c0-cb8a-4da4-9d02-66455a23bbe1" (UID: "0c6881c0-cb8a-4da4-9d02-66455a23bbe1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:14.205077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.205014 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv" pod "0c6881c0-cb8a-4da4-9d02-66455a23bbe1" (UID: "0c6881c0-cb8a-4da4-9d02-66455a23bbe1"). InnerVolumeSpecName "kube-api-access-bzbjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:14.205512 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.205487 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca" pod "0c6881c0-cb8a-4da4-9d02-66455a23bbe1" (UID: "0c6881c0-cb8a-4da4-9d02-66455a23bbe1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:23:14.303724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.303698 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzbjv\" (UniqueName: \"kubernetes.io/projected/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-kube-api-access-bzbjv\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:14.303724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.303721 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:14.303894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.303731 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c6881c0-cb8a-4da4-9d02-66455a23bbe1-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:14.960826 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.960756 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" Oct 29 23:23:14.960826 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.960771 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p" event={"ID":"0c6881c0-cb8a-4da4-9d02-66455a23bbe1","Type":"ContainerDied","Data":"8fff60a9d04dbcf38860f3396c8a23db80e2d46abefd278f959954dc676c59ca"} Oct 29 23:23:14.960826 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:14.960810 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fff60a9d04dbcf38860f3396c8a23db80e2d46abefd278f959954dc676c59ca" Oct 29 23:23:23.548661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:23.548628 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr"] Oct 29 23:23:23.559521 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:23.559488 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46444d59-jp6nr"] Oct 29 23:23:23.956079 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:23.956049 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d5afda5-ee67-457c-b596-e856e821e0c6" path="/var/lib/kubelet/pods/7d5afda5-ee67-457c-b596-e856e821e0c6/volumes" Oct 29 23:23:23.996992 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:23.996964 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p"] Oct 29 23:23:24.007016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:24.006986 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e687ff69-4f42p"] Oct 29 23:23:25.956579 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:25.956542 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c6881c0-cb8a-4da4-9d02-66455a23bbe1" path="/var/lib/kubelet/pods/0c6881c0-cb8a-4da4-9d02-66455a23bbe1/volumes" Oct 29 23:23:26.346099 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:26.346002 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:23:31.046090 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:31.046054 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:23:31.070112 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:31.070085 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2"] Oct 29 23:23:36.071113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.071059 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" podUID="5f2e3d58-c3b5-4425-b205-9eb6b165f886" containerName="payload-processing" containerID="cri-o://da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353" gracePeriod=25 Oct 29 23:23:36.317429 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.317405 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:23:36.509644 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.509611 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr\" (UniqueName: \"kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr\") pod \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " Oct 29 23:23:36.509813 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.509703 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume\") pod \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\" (UID: \"5f2e3d58-c3b5-4425-b205-9eb6b165f886\") " Oct 29 23:23:36.510071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.510043 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume" pod "5f2e3d58-c3b5-4425-b205-9eb6b165f886" (UID: "5f2e3d58-c3b5-4425-b205-9eb6b165f886"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:23:36.511742 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.511720 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr" pod "5f2e3d58-c3b5-4425-b205-9eb6b165f886" (UID: "5f2e3d58-c3b5-4425-b205-9eb6b165f886"). InnerVolumeSpecName "kube-api-access-cfdsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:23:36.611371 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.611349 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfdsr\" (UniqueName: \"kubernetes.io/projected/5f2e3d58-c3b5-4425-b205-9eb6b165f886-kube-api-access-cfdsr\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:36.611371 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:36.611371 6133 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f2e3d58-c3b5-4425-b205-9eb6b165f886-plugins-config-volume\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:23:37.079233 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.079194 6133 generic.go:356] "Generic (PLEG): container finished" podID="5f2e3d58-c3b5-4425-b205-9eb6b165f886" containerID="da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353" exitCode=0 Oct 29 23:23:37.079663 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.079240 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" Oct 29 23:23:37.079663 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.079278 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" event={"ID":"5f2e3d58-c3b5-4425-b205-9eb6b165f886","Type":"ContainerDied","Data":"da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353"} Oct 29 23:23:37.079663 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.079344 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2" event={"ID":"5f2e3d58-c3b5-4425-b205-9eb6b165f886","Type":"ContainerDied","Data":"b79db3035c4bf819de5ca78adfb7aec73f22d99996b4f114fcd4f25cc598fd55"} Oct 29 23:23:37.079663 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.079373 6133 scope.go:122] "RemoveContainer" containerID="da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353" Oct 29 23:23:37.089581 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.089564 6133 scope.go:122] "RemoveContainer" containerID="da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353" Oct 29 23:23:37.089867 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:23:37.089846 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353\": container with ID starting with da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353 not found: ID does not exist" containerID="da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353" Oct 29 23:23:37.089940 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.089879 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353"} err="failed to get container status \"da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353\": rpc error: code = NotFound desc = could not find container \"da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353\": container with ID starting with da98fea128c15c20eaa065fd808db561b1103c99c1ff049fa6e3fdd7f94c7353 not found: ID does not exist" Oct 29 23:23:37.125973 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.125952 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2"] Oct 29 23:23:37.136948 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.136928 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-83198dc0-7996c8cc64-cxhv2"] Oct 29 23:23:37.956090 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:37.956052 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f2e3d58-c3b5-4425-b205-9eb6b165f886" path="/var/lib/kubelet/pods/5f2e3d58-c3b5-4425-b205-9eb6b165f886/volumes" Oct 29 23:23:39.534397 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:39.534351 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:23:41.179697 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.179659 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw"] Oct 29 23:23:41.180773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180737 6133 cpu_manager.go:414] "containerMap: removing container" podUID="5f2e3d58-c3b5-4425-b205-9eb6b165f886" containerName="payload-processing" Oct 29 23:23:41.180773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180764 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f2e3d58-c3b5-4425-b205-9eb6b165f886" containerName="payload-processing" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180802 6133 cpu_manager.go:414] "containerMap: removing container" podUID="7d5afda5-ee67-457c-b596-e856e821e0c6" containerName="revoke-keys" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180809 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d5afda5-ee67-457c-b596-e856e821e0c6" containerName="revoke-keys" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180828 6133 cpu_manager.go:414] "containerMap: removing container" podUID="0c6881c0-cb8a-4da4-9d02-66455a23bbe1" containerName="revoke-keys" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180835 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c6881c0-cb8a-4da4-9d02-66455a23bbe1" containerName="revoke-keys" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180914 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f2e3d58-c3b5-4425-b205-9eb6b165f886" containerName="payload-processing" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180929 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d5afda5-ee67-457c-b596-e856e821e0c6" containerName="revoke-keys" Oct 29 23:23:41.180936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.180938 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c6881c0-cb8a-4da4-9d02-66455a23bbe1" containerName="revoke-keys" Oct 29 23:23:41.186121 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.186096 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.204017 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.203991 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-b2c5f2-openshift-default-dockercfg-rvfxs\"" Oct 29 23:23:41.217823 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.217781 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw"] Oct 29 23:23:41.253860 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.253823 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.253883 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.253962 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254002 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.253989 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnrs4\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.254012 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254172 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.254156 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.254190 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254253 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.254225 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.254332 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.254319 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.354773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.354738 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.354941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.354780 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrs4\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.354941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.354840 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.354941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.354907 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.354941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.354934 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355173 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.354962 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355173 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355050 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355173 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355075 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355173 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355107 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355544 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355519 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355622 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355560 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355645 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355785 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.355937 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.355918 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.357554 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.357524 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.357659 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.357619 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.373679 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.373654 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnrs4\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.373917 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.373900 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token\") pod \"e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.500308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.500212 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:41.816485 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.816213 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw"] Oct 29 23:23:41.820932 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:23:41.820897 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d52357b_4f71_4935_ae14_9990ac1dbc52.slice/crio-3fc916322b68f0a66975a86cbf701eba088276c6a19b521f52ec6ceafcb00935 WatchSource:0}: Error finding container 3fc916322b68f0a66975a86cbf701eba088276c6a19b521f52ec6ceafcb00935: Status 404 returned error can't find the container with id 3fc916322b68f0a66975a86cbf701eba088276c6a19b521f52ec6ceafcb00935 Oct 29 23:23:41.823596 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.823564 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:23:41.823664 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.823633 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:23:41.823700 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:41.823665 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:23:42.115196 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:42.115164 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" event={"ID":"2d52357b-4f71-4935-ae14-9990ac1dbc52","Type":"ContainerStarted","Data":"335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed"} Oct 29 23:23:42.115410 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:42.115223 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" event={"ID":"2d52357b-4f71-4935-ae14-9990ac1dbc52","Type":"ContainerStarted","Data":"3fc916322b68f0a66975a86cbf701eba088276c6a19b521f52ec6ceafcb00935"} Oct 29 23:23:42.158979 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:42.158925 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podStartSLOduration=1.158912653 podStartE2EDuration="1.158912653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:42.15773018 +0000 UTC m=+578.318917767" watchObservedRunningTime="2026-10-29 23:23:42.158912653 +0000 UTC m=+578.320100223" Oct 29 23:23:42.501092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:42.501013 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:42.506110 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:42.506086 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:43.125412 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:43.125378 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:43.126605 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:43.126580 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:23:43.447833 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:23:43.447755 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:23:44.524977 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:44.524942 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:23:51.671051 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:23:51.671021 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:01.677701 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:01.677668 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:04.035659 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:04.035629 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:24:04.039828 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:04.039807 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:24:08.735521 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:08.735482 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:11.288388 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.288317 6133 generic.go:356] "Generic (PLEG): container finished" podID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerID="335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed" exitCode=0 Oct 29 23:24:11.288806 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.288377 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" event={"ID":"2d52357b-4f71-4935-ae14-9990ac1dbc52","Type":"ContainerDied","Data":"335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed"} Oct 29 23:24:11.288806 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.288774 6133 scope.go:122] "RemoveContainer" containerID="335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed" Oct 29 23:24:11.290074 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.290049 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:24:11.290159 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.290114 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:24:11.290159 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.290146 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:24:11.563375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.560888 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl"] Oct 29 23:24:11.563920 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.563894 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.578367 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.578258 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"openshift-service-ca.crt\"" Oct 29 23:24:11.578367 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.578275 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"default-dockercfg-bjh5f\"" Oct 29 23:24:11.578841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.578371 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"simulator-w0-b0153c-kserve-self-signed-certs\"" Oct 29 23:24:11.578841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.578633 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"kube-root-ca.crt\"" Oct 29 23:24:11.585321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.585051 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl"] Oct 29 23:24:11.665756 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.665722 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.665931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.665776 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.665931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.665843 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.666053 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.665976 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.666053 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.666014 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.666132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.666105 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8d5w\" (UniqueName: \"kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.767660 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.767614 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.767852 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.767669 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.767852 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.767706 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d5w\" (UniqueName: \"kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.767852 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.767772 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.767852 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.767827 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.768020 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.767865 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.768353 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.768320 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.768501 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.768393 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.768636 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.768605 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.776647 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.776620 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.798929 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.798893 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8d5w\" (UniqueName: \"kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.799162 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.798968 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs\") pod \"simulator-w0-b0153c-kserve-f755c6757-6r5wl\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:11.878656 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:11.878621 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:12.211116 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:12.211034 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl"] Oct 29 23:24:12.216045 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:24:12.215056 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e5ba256_eaef_481f_bffb_84f3e4c1eb5c.slice/crio-ee639d28c4a2c6cdc3287d80f400ddf063575960955db79c58a4ce975883f61b WatchSource:0}: Error finding container ee639d28c4a2c6cdc3287d80f400ddf063575960955db79c58a4ce975883f61b: Status 404 returned error can't find the container with id ee639d28c4a2c6cdc3287d80f400ddf063575960955db79c58a4ce975883f61b Oct 29 23:24:12.308756 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:12.308717 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" event={"ID":"2d52357b-4f71-4935-ae14-9990ac1dbc52","Type":"ContainerStarted","Data":"55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89"} Oct 29 23:24:12.310126 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:12.310094 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" event={"ID":"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c","Type":"ContainerStarted","Data":"ee639d28c4a2c6cdc3287d80f400ddf063575960955db79c58a4ce975883f61b"} Oct 29 23:24:12.503622 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:12.503537 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:24:12.503803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:12.503721 6133 patch_prober.go:29] interesting pod/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Oct 29 23:24:12.503803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:12.503766 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Oct 29 23:24:13.126113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:13.126079 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:24:13.452499 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:24:13.452414 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:24:13.500953 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:13.500914 6133 patch_prober.go:29] interesting pod/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Oct 29 23:24:13.501144 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:13.500990 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Oct 29 23:24:14.323333 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:14.323295 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" event={"ID":"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c","Type":"ContainerStarted","Data":"5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36"} Oct 29 23:24:14.361485 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:14.361432 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" podStartSLOduration=1.910365455 podStartE2EDuration="3.361416311s" totalImagesPullingTime="1.451050856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:14.360407397 +0000 UTC m=+610.521594970" watchObservedRunningTime="2026-10-29 23:24:14.361416311 +0000 UTC m=+610.522603926" Oct 29 23:24:14.500654 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:14.500614 6133 patch_prober.go:29] interesting pod/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Oct 29 23:24:14.501168 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:14.500671 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Oct 29 23:24:14.884307 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:14.881371 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:15.501071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:15.501037 6133 patch_prober.go:29] interesting pod/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Oct 29 23:24:15.501480 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:15.501090 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Oct 29 23:24:16.503772 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:16.503739 6133 patch_prober.go:29] interesting pod/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Oct 29 23:24:16.504378 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:16.504344 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Oct 29 23:24:17.505030 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:17.504994 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:24:17.506081 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:17.506062 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:24:17.653994 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:17.653958 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:21.879300 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:21.879249 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:21.893657 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:21.893628 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:22.388963 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:22.388935 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:24:25.464300 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.464250 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc"] Oct 29 23:24:25.470894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.470860 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.497214 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.497188 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"kube-root-ca.crt\"" Oct 29 23:24:25.497214 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.497193 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"openshift-service-ca.crt\"" Oct 29 23:24:25.497415 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.497302 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"premium-w3-105882-kserve-self-signed-certs\"" Oct 29 23:24:25.497415 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.497338 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"default-dockercfg-dbxcz\"" Oct 29 23:24:25.500048 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.500019 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc"] Oct 29 23:24:25.527851 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.527819 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.528012 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.527862 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.528062 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.528008 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqfb\" (UniqueName: \"kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.528098 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.528077 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.528151 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.528137 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.528196 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.528163 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629192 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629153 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629192 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629203 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629469 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629410 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629531 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629471 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629593 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629578 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqfb\" (UniqueName: \"kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629652 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629610 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.629652 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.629613 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.630253 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.630225 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.630533 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.630513 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.632041 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.632008 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.632615 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.632593 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.647762 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.647739 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqfb\" (UniqueName: \"kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb\") pod \"premium-w3-105882-kserve-5b5f7f556f-6nffc\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:25.658120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.658090 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:25.785368 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:25.785272 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:26.088815 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:26.088732 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc"] Oct 29 23:24:26.092402 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:24:26.092367 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8581726_bfac_4562_ba8d_8c8e4207f869.slice/crio-c64f11150cc79eb151f3037d21f747a607466703ba999e5ea2671c5251985c00 WatchSource:0}: Error finding container c64f11150cc79eb151f3037d21f747a607466703ba999e5ea2671c5251985c00: Status 404 returned error can't find the container with id c64f11150cc79eb151f3037d21f747a607466703ba999e5ea2671c5251985c00 Oct 29 23:24:26.400973 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:26.400934 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" event={"ID":"c8581726-bfac-4562-ba8d-8c8e4207f869","Type":"ContainerStarted","Data":"bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02"} Oct 29 23:24:26.401175 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:26.400988 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" event={"ID":"c8581726-bfac-4562-ba8d-8c8e4207f869","Type":"ContainerStarted","Data":"c64f11150cc79eb151f3037d21f747a607466703ba999e5ea2671c5251985c00"} Oct 29 23:24:26.439749 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:26.439696 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" podStartSLOduration=1.4396823570000001 podStartE2EDuration="1.439682357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:26.438037493 +0000 UTC m=+622.599225062" watchObservedRunningTime="2026-10-29 23:24:26.439682357 +0000 UTC m=+622.600869926" Oct 29 23:24:26.785749 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:26.785678 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:35.786365 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:35.786329 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:35.799482 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:35.799454 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:36.467174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:36.467144 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:24:36.560253 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:36.560221 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:43.448957 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:24:43.448913 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:24:47.670630 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:47.670592 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:24:48.040397 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.040310 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq"] Oct 29 23:24:48.043908 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.043883 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.070946 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.070921 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"default-dockercfg-b2kl2\"" Oct 29 23:24:48.071370 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.071340 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"premium-w1-b2c5f2-kserve-self-signed-certs\"" Oct 29 23:24:48.073166 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.073140 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq"] Oct 29 23:24:48.074014 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.073986 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"kube-root-ca.crt\"" Oct 29 23:24:48.074107 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.074041 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"openshift-service-ca.crt\"" Oct 29 23:24:48.137580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.137546 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.137722 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.137591 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xfct\" (UniqueName: \"kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.137722 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.137618 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.137834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.137733 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.137834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.137759 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.137834 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.137780 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.238704 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.238655 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.238886 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.238780 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xfct\" (UniqueName: \"kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.238886 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.238839 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.238886 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.238870 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.239070 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.238894 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.239070 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.238913 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.239856 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.239823 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.240125 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.240103 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.240236 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.240190 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.241982 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.241958 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.246082 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.246053 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.259320 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.259276 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xfct\" (UniqueName: \"kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct\") pod \"premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.359837 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.359760 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:48.666208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:48.666184 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq"] Oct 29 23:24:48.668830 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:24:48.668802 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6735096c_e882_4415_b48b_d85ff8c5c2e4.slice/crio-e09177b414f6ad6ddb68d00700892d27ff5cee1076f16e5a943ad4f77f5e5267 WatchSource:0}: Error finding container e09177b414f6ad6ddb68d00700892d27ff5cee1076f16e5a943ad4f77f5e5267: Status 404 returned error can't find the container with id e09177b414f6ad6ddb68d00700892d27ff5cee1076f16e5a943ad4f77f5e5267 Oct 29 23:24:49.543853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:49.543817 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" event={"ID":"6735096c-e882-4415-b48b-d85ff8c5c2e4","Type":"ContainerStarted","Data":"e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403"} Oct 29 23:24:49.544223 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:49.543863 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" event={"ID":"6735096c-e882-4415-b48b-d85ff8c5c2e4","Type":"ContainerStarted","Data":"e09177b414f6ad6ddb68d00700892d27ff5cee1076f16e5a943ad4f77f5e5267"} Oct 29 23:24:49.587585 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:49.587533 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" podStartSLOduration=1.587516997 podStartE2EDuration="1.587516997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:49.586776456 +0000 UTC m=+645.747964026" watchObservedRunningTime="2026-10-29 23:24:49.587516997 +0000 UTC m=+645.748704567" Oct 29 23:24:50.360043 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:50.360007 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:58.360438 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:58.360406 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:58.372990 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:58.372961 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:24:58.604785 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:24:58.604748 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:25:08.573739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.573702 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd"] Oct 29 23:25:08.578953 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.578933 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.594491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.594461 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:25:08.612658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.605382 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:25:08.612658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.605436 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:25:08.612658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.605380 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:25:08.612658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.608332 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd"] Oct 29 23:25:08.626299 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.620128 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lsf8\" (UniqueName: \"kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.626299 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.620201 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.626299 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.620276 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.720995 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.720965 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.721127 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.721024 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.721127 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.721074 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lsf8\" (UniqueName: \"kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.721657 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.721632 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.723388 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.723370 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.738918 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.738899 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lsf8\" (UniqueName: \"kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8\") pod \"maas-api-revoke-sub-5d48b012-w2bpd\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:08.891567 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:08.891539 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:09.196937 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:09.196848 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd"] Oct 29 23:25:09.202220 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:25:09.202191 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066a2b3b_0226_441f_886a_0ba38068bb87.slice/crio-4c77d16046f691b3824d3781905d9bddd6eb58502dc3a6c55167e68839a0a88f WatchSource:0}: Error finding container 4c77d16046f691b3824d3781905d9bddd6eb58502dc3a6c55167e68839a0a88f: Status 404 returned error can't find the container with id 4c77d16046f691b3824d3781905d9bddd6eb58502dc3a6c55167e68839a0a88f Oct 29 23:25:09.355527 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:09.355502 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:25:09.657033 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:09.656992 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" event={"ID":"066a2b3b-0226-441f-886a-0ba38068bb87","Type":"ContainerStarted","Data":"5eb5400f0950296cdf52c3765540c017663c6b27ae0353d5bdf8810ff2914eb2"} Oct 29 23:25:09.657492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:09.657055 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" event={"ID":"066a2b3b-0226-441f-886a-0ba38068bb87","Type":"ContainerStarted","Data":"4c77d16046f691b3824d3781905d9bddd6eb58502dc3a6c55167e68839a0a88f"} Oct 29 23:25:09.696838 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:09.696788 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" podStartSLOduration=1.696771925 podStartE2EDuration="1.696771925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:09.695034688 +0000 UTC m=+665.856222257" watchObservedRunningTime="2026-10-29 23:25:09.696771925 +0000 UTC m=+665.857959498" Oct 29 23:25:10.664455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:10.664424 6133 generic.go:356] "Generic (PLEG): container finished" podID="066a2b3b-0226-441f-886a-0ba38068bb87" containerID="5eb5400f0950296cdf52c3765540c017663c6b27ae0353d5bdf8810ff2914eb2" exitCode=0 Oct 29 23:25:10.664885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:10.664517 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" event={"ID":"066a2b3b-0226-441f-886a-0ba38068bb87","Type":"ContainerDied","Data":"5eb5400f0950296cdf52c3765540c017663c6b27ae0353d5bdf8810ff2914eb2"} Oct 29 23:25:11.156074 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.156041 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8"] Oct 29 23:25:11.159634 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.159613 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.178872 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.178851 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-bacddc-openshift-default-dockercfg-xtxwv\"" Oct 29 23:25:11.190843 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.190813 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8"] Oct 29 23:25:11.245571 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245548 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.245698 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245579 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.245698 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245599 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.245698 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245669 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.245894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245782 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.245894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245806 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.245894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245824 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.246050 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.245965 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9tb\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.246050 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.246024 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347080 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347057 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9tb\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347209 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347097 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347209 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347121 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347209 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347139 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347209 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347159 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347452 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347309 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347452 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347379 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347452 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347417 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347452 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347447 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347646 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347522 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347646 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347576 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.347753 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347679 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.348008 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347981 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.348008 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.347997 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.349559 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.349538 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.349771 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.349753 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.365091 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.365072 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.365174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.365141 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9tb\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.472677 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.472595 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:11.813264 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.813235 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:11.815144 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.815118 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8"] Oct 29 23:25:11.815350 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:25:11.815327 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf51f772e_f42b_4ccf_8399_a27c6a6de564.slice/crio-18a08ff102b96c7bcd7fc027da91104fd20347dfae779d5d8bacea0c4ce78ebf WatchSource:0}: Error finding container 18a08ff102b96c7bcd7fc027da91104fd20347dfae779d5d8bacea0c4ce78ebf: Status 404 returned error can't find the container with id 18a08ff102b96c7bcd7fc027da91104fd20347dfae779d5d8bacea0c4ce78ebf Oct 29 23:25:11.818248 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.818212 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:11.818418 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.818395 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:11.818469 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.818450 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:11.861238 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.861213 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8\" (UniqueName: \"kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8\") pod \"066a2b3b-0226-441f-886a-0ba38068bb87\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " Oct 29 23:25:11.861383 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.861304 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca\") pod \"066a2b3b-0226-441f-886a-0ba38068bb87\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " Oct 29 23:25:11.861383 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.861352 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca\") pod \"066a2b3b-0226-441f-886a-0ba38068bb87\" (UID: \"066a2b3b-0226-441f-886a-0ba38068bb87\") " Oct 29 23:25:11.861865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.861841 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca" pod "066a2b3b-0226-441f-886a-0ba38068bb87" (UID: "066a2b3b-0226-441f-886a-0ba38068bb87"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:25:11.863722 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.863693 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca" pod "066a2b3b-0226-441f-886a-0ba38068bb87" (UID: "066a2b3b-0226-441f-886a-0ba38068bb87"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:25:11.863828 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.863809 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8" pod "066a2b3b-0226-441f-886a-0ba38068bb87" (UID: "066a2b3b-0226-441f-886a-0ba38068bb87"). InnerVolumeSpecName "kube-api-access-2lsf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:25:11.962451 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.962421 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lsf8\" (UniqueName: \"kubernetes.io/projected/066a2b3b-0226-441f-886a-0ba38068bb87-kube-api-access-2lsf8\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:11.962451 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.962449 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:11.962451 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:11.962458 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/066a2b3b-0226-441f-886a-0ba38068bb87-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:12.708423 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:12.708388 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" Oct 29 23:25:12.708423 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:12.708409 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5d48b012-w2bpd" event={"ID":"066a2b3b-0226-441f-886a-0ba38068bb87","Type":"ContainerDied","Data":"4c77d16046f691b3824d3781905d9bddd6eb58502dc3a6c55167e68839a0a88f"} Oct 29 23:25:12.708710 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:12.708504 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c77d16046f691b3824d3781905d9bddd6eb58502dc3a6c55167e68839a0a88f" Oct 29 23:25:12.710576 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:12.710544 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" event={"ID":"f51f772e-f42b-4ccf-8399-a27c6a6de564","Type":"ContainerStarted","Data":"c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869"} Oct 29 23:25:12.710757 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:12.710741 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" event={"ID":"f51f772e-f42b-4ccf-8399-a27c6a6de564","Type":"ContainerStarted","Data":"18a08ff102b96c7bcd7fc027da91104fd20347dfae779d5d8bacea0c4ce78ebf"} Oct 29 23:25:12.764864 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:12.764823 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podStartSLOduration=1.764811793 podStartE2EDuration="1.764811793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:12.762893785 +0000 UTC m=+668.924081354" watchObservedRunningTime="2026-10-29 23:25:12.764811793 +0000 UTC m=+668.925999362" Oct 29 23:25:13.452078 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:25:13.452035 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:25:13.478308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:13.475576 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:13.491418 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:13.491384 6133 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Oct 29 23:25:13.491670 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:13.491640 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Oct 29 23:25:14.479311 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.478568 6133 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Oct 29 23:25:14.479311 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.478623 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Oct 29 23:25:14.903321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.901617 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq"] Oct 29 23:25:14.903321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.902199 6133 cpu_manager.go:414] "containerMap: removing container" podUID="066a2b3b-0226-441f-886a-0ba38068bb87" containerName="revoke-keys" Oct 29 23:25:14.903321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.902216 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="066a2b3b-0226-441f-886a-0ba38068bb87" containerName="revoke-keys" Oct 29 23:25:14.903321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.902370 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="066a2b3b-0226-441f-886a-0ba38068bb87" containerName="revoke-keys" Oct 29 23:25:14.907213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.907185 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:14.908346 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.908324 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq"] Oct 29 23:25:14.920247 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.920217 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qfnc\" (UniqueName: \"kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:14.920404 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.920296 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:14.920404 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.920376 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:14.921382 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.921363 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:25:14.932662 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.932631 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:25:14.932662 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.932642 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:25:14.932662 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:14.932655 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:25:15.020848 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.020815 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.020978 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.020954 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qfnc\" (UniqueName: \"kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.021048 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.021028 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.021541 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.021518 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.023375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.023351 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.039884 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.039855 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qfnc\" (UniqueName: \"kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc\") pod \"maas-api-revoke-sub-21d0cccf-z9bqq\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.224578 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.224498 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:15.478028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.477561 6133 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Oct 29 23:25:15.478028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.477623 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Oct 29 23:25:15.550459 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.550428 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq"] Oct 29 23:25:15.553910 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:25:15.553884 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e2fda1_dd37_4b6d_b621_f4e6f120e2ce.slice/crio-c665c443ba68b7c7839d4bcd8f5c602cc25717b18fffff1a89000f66ff977475 WatchSource:0}: Error finding container c665c443ba68b7c7839d4bcd8f5c602cc25717b18fffff1a89000f66ff977475: Status 404 returned error can't find the container with id c665c443ba68b7c7839d4bcd8f5c602cc25717b18fffff1a89000f66ff977475 Oct 29 23:25:15.730645 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.730549 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" event={"ID":"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce","Type":"ContainerStarted","Data":"c665c443ba68b7c7839d4bcd8f5c602cc25717b18fffff1a89000f66ff977475"} Oct 29 23:25:15.910768 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.910736 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl"] Oct 29 23:25:15.915888 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.915862 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.929705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.929676 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.929822 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.929732 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.929822 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.929784 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.929908 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.929891 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8wxs\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.929953 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.929918 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-b0153c-openshift-default-dockercfg-jp5q8\"" Oct 29 23:25:15.929985 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.929964 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.930054 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.930035 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.930106 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.930090 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.930146 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.930124 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.930196 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.930149 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:15.943716 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:15.943686 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl"] Oct 29 23:25:16.030943 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.030912 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031073 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.030950 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031073 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.030988 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031073 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031012 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031073 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031026 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031073 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031067 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8wxs\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031352 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031099 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031352 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031133 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031352 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031159 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.031657 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.031638 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.032069 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.032053 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.032234 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.032219 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.032410 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.032395 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.032829 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.032812 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.034486 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.034466 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.034631 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.034614 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.048706 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.048683 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.054636 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.054610 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8wxs\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.230673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.230635 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:16.474999 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.474589 6133 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Oct 29 23:25:16.474999 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.474645 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Oct 29 23:25:16.569629 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.569560 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl"] Oct 29 23:25:16.598301 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.596649 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:16.598301 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.596735 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:16.598301 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.596777 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:16.740298 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.739890 6133 generic.go:356] "Generic (PLEG): container finished" podID="95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" containerID="49bb5caea911f14251d776df813fdef3b0250996460dcb4105851e08a42186ff" exitCode=0 Oct 29 23:25:16.740298 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.740037 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" event={"ID":"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce","Type":"ContainerDied","Data":"49bb5caea911f14251d776df813fdef3b0250996460dcb4105851e08a42186ff"} Oct 29 23:25:16.743026 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.741865 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" event={"ID":"049c73e1-62d3-42f3-a34b-463380b9a3d9","Type":"ContainerStarted","Data":"6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520"} Oct 29 23:25:16.743026 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.741910 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" event={"ID":"049c73e1-62d3-42f3-a34b-463380b9a3d9","Type":"ContainerStarted","Data":"db65aa0c291633fc849d362d130e69d348bcbcc28ee690546fce9f180f95969c"} Oct 29 23:25:16.831385 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:16.831265 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podStartSLOduration=1.8312519630000001 podStartE2EDuration="1.831251963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:16.830802474 +0000 UTC m=+672.991990045" watchObservedRunningTime="2026-10-29 23:25:16.831251963 +0000 UTC m=+672.992439532" Oct 29 23:25:17.231810 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:17.231771 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:17.233310 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:17.233265 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:17.233436 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:17.233326 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:17.474651 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:17.474618 6133 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Oct 29 23:25:17.474938 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:17.474907 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Oct 29 23:25:18.018136 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.018066 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:18.051006 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.050983 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc\" (UniqueName: \"kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc\") pod \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " Oct 29 23:25:18.051139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.051036 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca\") pod \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " Oct 29 23:25:18.051139 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.051101 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca\") pod \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\" (UID: \"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce\") " Oct 29 23:25:18.051419 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.051398 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca" pod "95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" (UID: "95e2fda1-dd37-4b6d-b621-f4e6f120e2ce"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:25:18.051491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.051475 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:18.053099 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.053074 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca" pod "95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" (UID: "95e2fda1-dd37-4b6d-b621-f4e6f120e2ce"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:25:18.053208 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.053151 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc" pod "95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" (UID: "95e2fda1-dd37-4b6d-b621-f4e6f120e2ce"). InnerVolumeSpecName "kube-api-access-4qfnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:25:18.152200 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.152166 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:18.152200 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.152192 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qfnc\" (UniqueName: \"kubernetes.io/projected/95e2fda1-dd37-4b6d-b621-f4e6f120e2ce-kube-api-access-4qfnc\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:18.231133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.231094 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:18.231308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.231170 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:18.482417 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.479567 6133 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body= Oct 29 23:25:18.482417 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.479628 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" Oct 29 23:25:18.757098 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.757020 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" Oct 29 23:25:18.757098 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.757064 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21d0cccf-z9bqq" event={"ID":"95e2fda1-dd37-4b6d-b621-f4e6f120e2ce","Type":"ContainerDied","Data":"c665c443ba68b7c7839d4bcd8f5c602cc25717b18fffff1a89000f66ff977475"} Oct 29 23:25:18.757349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:18.757124 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c665c443ba68b7c7839d4bcd8f5c602cc25717b18fffff1a89000f66ff977475" Oct 29 23:25:19.231084 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:19.231050 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:19.231481 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:19.231113 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:19.484617 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:19.484538 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:19.486025 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:19.486003 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:19.491478 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:19.491460 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:25:20.231875 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:20.231839 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:20.232323 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:20.231891 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:21.231468 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:21.231435 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:21.231621 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:21.231486 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:22.231195 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:22.231162 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:22.231583 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:22.231218 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:23.231226 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:23.231183 6133 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Oct 29 23:25:23.231661 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:23.231254 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Oct 29 23:25:24.371879 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:24.371841 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:24.372353 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:24.372263 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:24.373174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:24.373154 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:25:28.752799 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:28.752764 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:25:40.648531 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.648497 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts"] Oct 29 23:25:40.649008 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.648883 6133 cpu_manager.go:414] "containerMap: removing container" podUID="95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" containerName="revoke-keys" Oct 29 23:25:40.649008 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.648893 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" containerName="revoke-keys" Oct 29 23:25:40.649008 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.648978 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="95e2fda1-dd37-4b6d-b621-f4e6f120e2ce" containerName="revoke-keys" Oct 29 23:25:40.652465 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.652448 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.678521 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.678493 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:25:40.678685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.678519 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:25:40.678685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.678634 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:25:40.678685 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.678645 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:25:40.683940 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.683915 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts"] Oct 29 23:25:40.806147 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.806122 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqsw\" (UniqueName: \"kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.806323 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.806204 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.806323 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.806247 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.907265 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.907185 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.907265 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.907217 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.907524 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.907309 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqsw\" (UniqueName: \"kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.907932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.907905 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.909571 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.909554 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.925805 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.925778 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqsw\" (UniqueName: \"kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw\") pod \"maas-api-revoke-sub-4c83377c-tr6ts\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:40.965597 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:40.965573 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:41.266464 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.266380 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts"] Oct 29 23:25:41.270488 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:25:41.270459 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc123cfb2_7270_4dd3_b9e9_e5c7c75da96a.slice/crio-3cb4238571ab0ba050efe9217235467395b08e673997b0a8ca5a5ce1ed691e20 WatchSource:0}: Error finding container 3cb4238571ab0ba050efe9217235467395b08e673997b0a8ca5a5ce1ed691e20: Status 404 returned error can't find the container with id 3cb4238571ab0ba050efe9217235467395b08e673997b0a8ca5a5ce1ed691e20 Oct 29 23:25:41.726181 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.725958 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm"] Oct 29 23:25:41.729717 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.729697 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.745529 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.745510 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-bed4a2-openshift-default-dockercfg-bgcfk\"" Oct 29 23:25:41.759153 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.759132 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm"] Oct 29 23:25:41.815470 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815433 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815631 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815489 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815631 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815540 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815717 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815683 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815751 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815716 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815793 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815752 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815825 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5plc\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815896 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815880 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.815936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.815925 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.915868 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.915828 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" event={"ID":"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a","Type":"ContainerStarted","Data":"43dea44ca5e2b672b0ffa89722baa2043ae84270f677af3b6e782d2abfbd39f2"} Oct 29 23:25:41.916056 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.915907 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" event={"ID":"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a","Type":"ContainerStarted","Data":"3cb4238571ab0ba050efe9217235467395b08e673997b0a8ca5a5ce1ed691e20"} Oct 29 23:25:41.916826 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.916798 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.916962 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.916843 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.916962 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.916880 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5plc\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.916962 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.916924 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917126 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.916977 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917207 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917190 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917315 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917268 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917368 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917336 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917515 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917499 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917557 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917546 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917610 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917573 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917610 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917579 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.917710 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.917633 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.918196 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.918174 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.920248 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.919774 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.920371 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.920356 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.937055 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.937036 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5plc\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.937909 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.937892 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:41.957315 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:41.957233 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" podStartSLOduration=1.957217731 podStartE2EDuration="1.957217731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:41.955332031 +0000 UTC m=+698.116519601" watchObservedRunningTime="2026-10-29 23:25:41.957217731 +0000 UTC m=+698.118405304" Oct 29 23:25:42.043147 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.043125 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:42.362259 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.362156 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm"] Oct 29 23:25:42.365011 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:25:42.364974 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bf6a12_08eb_497e_a424_d9b3d90a3a62.slice/crio-be776ee76e0034c7b7d3dbbc977c5f92d0e5426b7fcc5d81507ecb0058959971 WatchSource:0}: Error finding container be776ee76e0034c7b7d3dbbc977c5f92d0e5426b7fcc5d81507ecb0058959971: Status 404 returned error can't find the container with id be776ee76e0034c7b7d3dbbc977c5f92d0e5426b7fcc5d81507ecb0058959971 Oct 29 23:25:42.367375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.367341 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:42.367453 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.367421 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:42.367495 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.367460 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:25:42.924120 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.924089 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" event={"ID":"b2bf6a12-08eb-497e-a424-d9b3d90a3a62","Type":"ContainerStarted","Data":"333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983"} Oct 29 23:25:42.924531 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.924147 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" event={"ID":"b2bf6a12-08eb-497e-a424-d9b3d90a3a62","Type":"ContainerStarted","Data":"be776ee76e0034c7b7d3dbbc977c5f92d0e5426b7fcc5d81507ecb0058959971"} Oct 29 23:25:42.925907 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.925882 6133 generic.go:356] "Generic (PLEG): container finished" podID="c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" containerID="43dea44ca5e2b672b0ffa89722baa2043ae84270f677af3b6e782d2abfbd39f2" exitCode=0 Oct 29 23:25:42.926028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.925929 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" event={"ID":"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a","Type":"ContainerDied","Data":"43dea44ca5e2b672b0ffa89722baa2043ae84270f677af3b6e782d2abfbd39f2"} Oct 29 23:25:42.986305 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:42.984782 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podStartSLOduration=1.984762997 podStartE2EDuration="1.984762997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:42.983747743 +0000 UTC m=+699.144935314" watchObservedRunningTime="2026-10-29 23:25:42.984762997 +0000 UTC m=+699.145950568" Oct 29 23:25:43.044215 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:43.044186 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:43.045959 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:43.045934 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:25:43.046085 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:43.045984 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:25:43.448222 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:25:43.448189 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:25:44.044162 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.044125 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:25:44.044636 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.044185 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:25:44.132677 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.132652 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:44.241077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.240992 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw\" (UniqueName: \"kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw\") pod \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " Oct 29 23:25:44.241077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.241074 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca\") pod \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " Oct 29 23:25:44.241335 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.241141 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca\") pod \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\" (UID: \"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a\") " Oct 29 23:25:44.241588 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.241555 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca" pod "c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" (UID: "c123cfb2-7270-4dd3-b9e9-e5c7c75da96a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:25:44.243308 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.243255 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw" pod "c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" (UID: "c123cfb2-7270-4dd3-b9e9-e5c7c75da96a"). InnerVolumeSpecName "kube-api-access-mvqsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:25:44.243577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.243558 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca" pod "c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" (UID: "c123cfb2-7270-4dd3-b9e9-e5c7c75da96a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:25:44.342739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.342710 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvqsw\" (UniqueName: \"kubernetes.io/projected/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-kube-api-access-mvqsw\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:44.342739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.342734 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:44.342739 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.342745 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c123cfb2-7270-4dd3-b9e9-e5c7c75da96a-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:25:44.939517 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.939487 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" Oct 29 23:25:44.939677 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.939521 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c83377c-tr6ts" event={"ID":"c123cfb2-7270-4dd3-b9e9-e5c7c75da96a","Type":"ContainerDied","Data":"3cb4238571ab0ba050efe9217235467395b08e673997b0a8ca5a5ce1ed691e20"} Oct 29 23:25:44.939677 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:44.939566 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cb4238571ab0ba050efe9217235467395b08e673997b0a8ca5a5ce1ed691e20" Oct 29 23:25:45.044407 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:45.044373 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:25:45.044784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:45.044426 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:25:46.043502 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:46.043471 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:25:46.043672 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:46.043518 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:25:47.044503 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:47.044464 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:25:47.044973 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:47.044529 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:25:48.043879 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:48.043839 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Oct 29 23:25:48.044078 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:48.043896 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Oct 29 23:25:49.626590 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:49.626558 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:49.627084 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:49.626916 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:25:49.628082 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:25:49.628062 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:26:13.448608 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:26:13.448567 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:26:43.447883 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:26:43.447837 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:27:06.624242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:06.624207 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq"] Oct 29 23:27:08.166765 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:08.166728 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:27:09.231272 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.231235 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj"] Oct 29 23:27:09.231878 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.231859 6133 cpu_manager.go:414] "containerMap: removing container" podUID="c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" containerName="revoke-keys" Oct 29 23:27:09.231965 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.231878 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" containerName="revoke-keys" Oct 29 23:27:09.232055 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.232041 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="c123cfb2-7270-4dd3-b9e9-e5c7c75da96a" containerName="revoke-keys" Oct 29 23:27:09.235859 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.235835 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.262803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.262761 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:27:09.262803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.262778 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:27:09.262803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.262795 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:27:09.263036 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.262803 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:27:09.265115 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.265097 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj"] Oct 29 23:27:09.366074 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.366041 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.366255 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.366102 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.366255 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.366195 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sf2j\" (UniqueName: \"kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.467052 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.467018 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sf2j\" (UniqueName: \"kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.467242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.467145 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.467242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.467215 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.467944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.467914 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.470883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.470853 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.485931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.485868 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sf2j\" (UniqueName: \"kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.550423 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.550397 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:09.857230 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:09.857148 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj"] Oct 29 23:27:09.861116 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:09.861092 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633e63ff_dbdf_4a60_9292_65640089adb3.slice/crio-ba519857e1352895802bdc00c9b9b54722c8c00dac86d33d275594ff26f507dc WatchSource:0}: Error finding container ba519857e1352895802bdc00c9b9b54722c8c00dac86d33d275594ff26f507dc: Status 404 returned error can't find the container with id ba519857e1352895802bdc00c9b9b54722c8c00dac86d33d275594ff26f507dc Oct 29 23:27:10.440546 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:10.440447 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" event={"ID":"633e63ff-dbdf-4a60-9292-65640089adb3","Type":"ContainerStarted","Data":"a11ed46645ddf984e73c1cf20aa2468d11751a3d319907751d8698b4bfaf0047"} Oct 29 23:27:10.440546 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:10.440515 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" event={"ID":"633e63ff-dbdf-4a60-9292-65640089adb3","Type":"ContainerStarted","Data":"ba519857e1352895802bdc00c9b9b54722c8c00dac86d33d275594ff26f507dc"} Oct 29 23:27:10.479183 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:10.479136 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" podStartSLOduration=1.479122329 podStartE2EDuration="1.479122329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:10.476682529 +0000 UTC m=+786.637870101" watchObservedRunningTime="2026-10-29 23:27:10.479122329 +0000 UTC m=+786.640309899" Oct 29 23:27:11.447993 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:11.447953 6133 generic.go:356] "Generic (PLEG): container finished" podID="633e63ff-dbdf-4a60-9292-65640089adb3" containerID="a11ed46645ddf984e73c1cf20aa2468d11751a3d319907751d8698b4bfaf0047" exitCode=0 Oct 29 23:27:11.448441 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:11.448039 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" event={"ID":"633e63ff-dbdf-4a60-9292-65640089adb3","Type":"ContainerDied","Data":"a11ed46645ddf984e73c1cf20aa2468d11751a3d319907751d8698b4bfaf0047"} Oct 29 23:27:11.550093 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:11.550059 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc"] Oct 29 23:27:12.624069 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.624041 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:12.806545 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.806456 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca\") pod \"633e63ff-dbdf-4a60-9292-65640089adb3\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " Oct 29 23:27:12.806545 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.806522 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca\") pod \"633e63ff-dbdf-4a60-9292-65640089adb3\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " Oct 29 23:27:12.806780 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.806711 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j\" (UniqueName: \"kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j\") pod \"633e63ff-dbdf-4a60-9292-65640089adb3\" (UID: \"633e63ff-dbdf-4a60-9292-65640089adb3\") " Oct 29 23:27:12.806896 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.806875 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca" pod "633e63ff-dbdf-4a60-9292-65640089adb3" (UID: "633e63ff-dbdf-4a60-9292-65640089adb3"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:12.807144 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.807121 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:12.808588 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.808564 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca" pod "633e63ff-dbdf-4a60-9292-65640089adb3" (UID: "633e63ff-dbdf-4a60-9292-65640089adb3"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:12.808712 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.808696 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j" pod "633e63ff-dbdf-4a60-9292-65640089adb3" (UID: "633e63ff-dbdf-4a60-9292-65640089adb3"). InnerVolumeSpecName "kube-api-access-2sf2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:12.907964 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.907940 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sf2j\" (UniqueName: \"kubernetes.io/projected/633e63ff-dbdf-4a60-9292-65640089adb3-kube-api-access-2sf2j\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:12.907964 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:12.907965 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/633e63ff-dbdf-4a60-9292-65640089adb3-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:13.448196 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:13.448158 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:27:13.463212 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:13.463189 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" Oct 29 23:27:13.463375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:13.463228 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj" event={"ID":"633e63ff-dbdf-4a60-9292-65640089adb3","Type":"ContainerDied","Data":"ba519857e1352895802bdc00c9b9b54722c8c00dac86d33d275594ff26f507dc"} Oct 29 23:27:13.463375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:13.463296 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba519857e1352895802bdc00c9b9b54722c8c00dac86d33d275594ff26f507dc" Oct 29 23:27:13.887835 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:13.887800 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl"] Oct 29 23:27:17.678035 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.678000 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n"] Oct 29 23:27:17.678427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.678414 6133 cpu_manager.go:414] "containerMap: removing container" podUID="633e63ff-dbdf-4a60-9292-65640089adb3" containerName="revoke-keys" Oct 29 23:27:17.678427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.678427 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="633e63ff-dbdf-4a60-9292-65640089adb3" containerName="revoke-keys" Oct 29 23:27:17.678536 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.678527 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="633e63ff-dbdf-4a60-9292-65640089adb3" containerName="revoke-keys" Oct 29 23:27:17.682079 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.682054 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.701421 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.701393 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n"] Oct 29 23:27:17.752808 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.752780 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nsx9\" (UniqueName: \"kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.752947 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.752837 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.752947 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.752922 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.777916 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.777893 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:27:17.778054 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.777916 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:27:17.778054 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.777989 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:27:17.778054 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.777989 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:27:17.854341 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.854311 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nsx9\" (UniqueName: \"kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.854504 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.854353 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.854504 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.854370 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.854936 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.854915 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.856623 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.856602 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.874804 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.874745 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nsx9\" (UniqueName: \"kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9\") pod \"maas-api-revoke-sub-4c54a363-89z9n\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:17.998187 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:17.998114 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:18.305652 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:18.305573 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n"] Oct 29 23:27:18.308752 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:18.308723 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e8ef98_05d2_415b_8205_8831959c9b44.slice/crio-2d85c36650397ad9e8564604c6bf08cede7d8ac06154540897f9ebd8b22128b1 WatchSource:0}: Error finding container 2d85c36650397ad9e8564604c6bf08cede7d8ac06154540897f9ebd8b22128b1: Status 404 returned error can't find the container with id 2d85c36650397ad9e8564604c6bf08cede7d8ac06154540897f9ebd8b22128b1 Oct 29 23:27:18.495859 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:18.495802 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" event={"ID":"49e8ef98-05d2-415b-8205-8831959c9b44","Type":"ContainerStarted","Data":"2d85c36650397ad9e8564604c6bf08cede7d8ac06154540897f9ebd8b22128b1"} Oct 29 23:27:19.504241 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:19.504203 6133 generic.go:356] "Generic (PLEG): container finished" podID="49e8ef98-05d2-415b-8205-8831959c9b44" containerID="7edac9d6eb46db1d0e28cb803430e895476bb77d0191e31e356687a085bf4058" exitCode=0 Oct 29 23:27:19.504694 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:19.504296 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" event={"ID":"49e8ef98-05d2-415b-8205-8831959c9b44","Type":"ContainerDied","Data":"7edac9d6eb46db1d0e28cb803430e895476bb77d0191e31e356687a085bf4058"} Oct 29 23:27:20.675392 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.675365 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:20.784790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.784715 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9\" (UniqueName: \"kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9\") pod \"49e8ef98-05d2-415b-8205-8831959c9b44\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " Oct 29 23:27:20.784941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.784850 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca\") pod \"49e8ef98-05d2-415b-8205-8831959c9b44\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " Oct 29 23:27:20.784941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.784896 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca\") pod \"49e8ef98-05d2-415b-8205-8831959c9b44\" (UID: \"49e8ef98-05d2-415b-8205-8831959c9b44\") " Oct 29 23:27:20.785375 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.785348 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca" pod "49e8ef98-05d2-415b-8205-8831959c9b44" (UID: "49e8ef98-05d2-415b-8205-8831959c9b44"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:20.786944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.786915 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca" pod "49e8ef98-05d2-415b-8205-8831959c9b44" (UID: "49e8ef98-05d2-415b-8205-8831959c9b44"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:20.786944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.786935 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9" pod "49e8ef98-05d2-415b-8205-8831959c9b44" (UID: "49e8ef98-05d2-415b-8205-8831959c9b44"). InnerVolumeSpecName "kube-api-access-5nsx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:20.886279 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.886252 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:20.886279 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.886276 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49e8ef98-05d2-415b-8205-8831959c9b44-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:20.886479 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:20.886299 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nsx9\" (UniqueName: \"kubernetes.io/projected/49e8ef98-05d2-415b-8205-8831959c9b44-kube-api-access-5nsx9\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:21.517055 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.517015 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" event={"ID":"49e8ef98-05d2-415b-8205-8831959c9b44","Type":"ContainerDied","Data":"2d85c36650397ad9e8564604c6bf08cede7d8ac06154540897f9ebd8b22128b1"} Oct 29 23:27:21.517055 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.517035 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4c54a363-89z9n" Oct 29 23:27:21.517247 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.517067 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d85c36650397ad9e8564604c6bf08cede7d8ac06154540897f9ebd8b22128b1" Oct 29 23:27:21.644627 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.644592 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" podUID="6735096c-e882-4415-b48b-d85ff8c5c2e4" containerName="main" containerID="cri-o://e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403" gracePeriod=45 Oct 29 23:27:21.920405 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.920373 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:27:21.996206 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996171 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs\" (UniqueName: \"kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs\") pod \"6735096c-e882-4415-b48b-d85ff8c5c2e4\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " Oct 29 23:27:21.996429 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996271 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir\") pod \"6735096c-e882-4415-b48b-d85ff8c5c2e4\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " Oct 29 23:27:21.996429 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996369 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct\" (UniqueName: \"kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct\") pod \"6735096c-e882-4415-b48b-d85ff8c5c2e4\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " Oct 29 23:27:21.996550 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996507 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm\") pod \"6735096c-e882-4415-b48b-d85ff8c5c2e4\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " Oct 29 23:27:21.996550 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996541 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache\") pod \"6735096c-e882-4415-b48b-d85ff8c5c2e4\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " Oct 29 23:27:21.996667 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996596 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir" pod "6735096c-e882-4415-b48b-d85ff8c5c2e4" (UID: "6735096c-e882-4415-b48b-d85ff8c5c2e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:21.996667 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996611 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home\") pod \"6735096c-e882-4415-b48b-d85ff8c5c2e4\" (UID: \"6735096c-e882-4415-b48b-d85ff8c5c2e4\") " Oct 29 23:27:21.997155 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996844 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache" pod "6735096c-e882-4415-b48b-d85ff8c5c2e4" (UID: "6735096c-e882-4415-b48b-d85ff8c5c2e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:21.997155 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.996985 6133 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-model-cache\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:21.997155 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.997035 6133 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-tmp-dir\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:21.997155 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.997073 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home" pod "6735096c-e882-4415-b48b-d85ff8c5c2e4" (UID: "6735096c-e882-4415-b48b-d85ff8c5c2e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:21.999108 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.999072 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs" pod "6735096c-e882-4415-b48b-d85ff8c5c2e4" (UID: "6735096c-e882-4415-b48b-d85ff8c5c2e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:21.999356 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.999303 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct" pod "6735096c-e882-4415-b48b-d85ff8c5c2e4" (UID: "6735096c-e882-4415-b48b-d85ff8c5c2e4"). InnerVolumeSpecName "kube-api-access-2xfct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:21.999356 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:21.999275 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm" pod "6735096c-e882-4415-b48b-d85ff8c5c2e4" (UID: "6735096c-e882-4415-b48b-d85ff8c5c2e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:22.098092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.098013 6133 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-dshm\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:22.098092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.098041 6133 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735096c-e882-4415-b48b-d85ff8c5c2e4-home\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:22.098092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.098051 6133 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735096c-e882-4415-b48b-d85ff8c5c2e4-tls-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:22.098092 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.098061 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xfct\" (UniqueName: \"kubernetes.io/projected/6735096c-e882-4415-b48b-d85ff8c5c2e4-kube-api-access-2xfct\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:22.523453 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.523421 6133 generic.go:356] "Generic (PLEG): container finished" podID="6735096c-e882-4415-b48b-d85ff8c5c2e4" containerID="e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403" exitCode=0 Oct 29 23:27:22.523614 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.523470 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" Oct 29 23:27:22.523614 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.523508 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" event={"ID":"6735096c-e882-4415-b48b-d85ff8c5c2e4","Type":"ContainerDied","Data":"e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403"} Oct 29 23:27:22.523614 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.523554 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq" event={"ID":"6735096c-e882-4415-b48b-d85ff8c5c2e4","Type":"ContainerDied","Data":"e09177b414f6ad6ddb68d00700892d27ff5cee1076f16e5a943ad4f77f5e5267"} Oct 29 23:27:22.523614 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.523571 6133 scope.go:122] "RemoveContainer" containerID="e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403" Oct 29 23:27:22.533379 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.533363 6133 scope.go:122] "RemoveContainer" containerID="e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403" Oct 29 23:27:22.533639 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:22.533619 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403\": container with ID starting with e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403 not found: ID does not exist" containerID="e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403" Oct 29 23:27:22.533696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.533651 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403"} err="failed to get container status \"e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403\": rpc error: code = NotFound desc = could not find container \"e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403\": container with ID starting with e73d83c3c294c471e1b3d96d7925be640fa47815d82f5456cf07b47cc3d22403 not found: ID does not exist" Oct 29 23:27:22.574183 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.574157 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq"] Oct 29 23:27:22.585056 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:22.585029 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/premium-w1-b2c5f2-kserve-85d6dc4849-qfhmq"] Oct 29 23:27:23.958498 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:23.958468 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6735096c-e882-4415-b48b-d85ff8c5c2e4" path="/var/lib/kubelet/pods/6735096c-e882-4415-b48b-d85ff8c5c2e4/volumes" Oct 29 23:27:24.647338 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:24.647301 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:27:25.147147 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147114 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb"] Oct 29 23:27:25.147581 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147567 6133 cpu_manager.go:414] "containerMap: removing container" podUID="6735096c-e882-4415-b48b-d85ff8c5c2e4" containerName="main" Oct 29 23:27:25.147624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147582 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6735096c-e882-4415-b48b-d85ff8c5c2e4" containerName="main" Oct 29 23:27:25.147624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147598 6133 cpu_manager.go:414] "containerMap: removing container" podUID="49e8ef98-05d2-415b-8205-8831959c9b44" containerName="revoke-keys" Oct 29 23:27:25.147624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147605 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49e8ef98-05d2-415b-8205-8831959c9b44" containerName="revoke-keys" Oct 29 23:27:25.147718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147666 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="6735096c-e882-4415-b48b-d85ff8c5c2e4" containerName="main" Oct 29 23:27:25.147718 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.147676 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="49e8ef98-05d2-415b-8205-8831959c9b44" containerName="revoke-keys" Oct 29 23:27:25.150647 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.150625 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.172699 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.172675 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb"] Oct 29 23:27:25.229825 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.229789 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msf44\" (UniqueName: \"kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.229973 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.229883 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.230024 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.229977 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.250726 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.249424 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:27:25.250726 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.249496 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:27:25.250726 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.249546 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:27:25.250726 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.249767 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:27:25.256844 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.256821 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6"] Oct 29 23:27:25.262024 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.262003 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.277942 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.277918 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6"] Oct 29 23:27:25.330801 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.330770 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.330932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.330828 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.330932 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.330892 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.331019 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.330964 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.331074 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.331053 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv79p\" (UniqueName: \"kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.331113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.331096 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msf44\" (UniqueName: \"kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.331569 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.331548 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.333186 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.333166 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.350047 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.350020 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msf44\" (UniqueName: \"kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44\") pod \"maas-api-revoke-sub-d998e766-jqpcb\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.432330 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.432221 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.432514 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.432338 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.432514 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.432383 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv79p\" (UniqueName: \"kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.433101 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.433072 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.434728 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.434707 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.450533 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.450512 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv79p\" (UniqueName: \"kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p\") pod \"maas-api-revoke-sub-893654db-zs9m6\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.464790 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.464766 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:25.576744 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.576714 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:25.764664 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.764574 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb"] Oct 29 23:27:25.768195 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:25.768166 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa92d32_2ef7_4b57_8de0_8de4e24af86a.slice/crio-3e06f8102f71e86297a985afabc19b4badc69967293e4b8ecf17840e22f85c95 WatchSource:0}: Error finding container 3e06f8102f71e86297a985afabc19b4badc69967293e4b8ecf17840e22f85c95: Status 404 returned error can't find the container with id 3e06f8102f71e86297a985afabc19b4badc69967293e4b8ecf17840e22f85c95 Oct 29 23:27:25.898128 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:25.898018 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6"] Oct 29 23:27:25.904043 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:25.904009 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6872c2_b808_4c91_83d3_07f161e90ea0.slice/crio-1bc5e34e692319243eb6f5491f82354144e767f892a1304de4dd400d5f96924b WatchSource:0}: Error finding container 1bc5e34e692319243eb6f5491f82354144e767f892a1304de4dd400d5f96924b: Status 404 returned error can't find the container with id 1bc5e34e692319243eb6f5491f82354144e767f892a1304de4dd400d5f96924b Oct 29 23:27:26.549624 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.549590 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" event={"ID":"8d6872c2-b808-4c91-83d3-07f161e90ea0","Type":"ContainerStarted","Data":"132072f759c898fa73e572f3630e575e9546b58186aa9b2fdd194f3e38cc7bd9"} Oct 29 23:27:26.550117 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.549647 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" event={"ID":"8d6872c2-b808-4c91-83d3-07f161e90ea0","Type":"ContainerStarted","Data":"1bc5e34e692319243eb6f5491f82354144e767f892a1304de4dd400d5f96924b"} Oct 29 23:27:26.552814 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.552789 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" event={"ID":"3aa92d32-2ef7-4b57-8de0-8de4e24af86a","Type":"ContainerStarted","Data":"119a0a78426dddf61cd56388b7e7bc946ef9cd6398ecce69519b5f1930754c7f"} Oct 29 23:27:26.552935 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.552829 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" event={"ID":"3aa92d32-2ef7-4b57-8de0-8de4e24af86a","Type":"ContainerStarted","Data":"3e06f8102f71e86297a985afabc19b4badc69967293e4b8ecf17840e22f85c95"} Oct 29 23:27:26.571326 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.571154 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" podUID="c8581726-bfac-4562-ba8d-8c8e4207f869" containerName="main" containerID="cri-o://bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02" gracePeriod=45 Oct 29 23:27:26.590695 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.590652 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" podStartSLOduration=1.59063954 podStartE2EDuration="1.59063954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:26.588961862 +0000 UTC m=+802.750149431" watchObservedRunningTime="2026-10-29 23:27:26.59063954 +0000 UTC m=+802.751827109" Oct 29 23:27:26.634271 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.634209 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" podStartSLOduration=1.634192406 podStartE2EDuration="1.634192406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:26.630438347 +0000 UTC m=+802.791625918" watchObservedRunningTime="2026-10-29 23:27:26.634192406 +0000 UTC m=+802.795379976" Oct 29 23:27:26.860243 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.860220 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:27:26.949540 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949508 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm\") pod \"c8581726-bfac-4562-ba8d-8c8e4207f869\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " Oct 29 23:27:26.949673 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949600 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache\") pod \"c8581726-bfac-4562-ba8d-8c8e4207f869\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " Oct 29 23:27:26.949728 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949668 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb\" (UniqueName: \"kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb\") pod \"c8581726-bfac-4562-ba8d-8c8e4207f869\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " Oct 29 23:27:26.949728 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949715 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir\") pod \"c8581726-bfac-4562-ba8d-8c8e4207f869\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " Oct 29 23:27:26.949809 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949795 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs\") pod \"c8581726-bfac-4562-ba8d-8c8e4207f869\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " Oct 29 23:27:26.949856 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949819 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home\") pod \"c8581726-bfac-4562-ba8d-8c8e4207f869\" (UID: \"c8581726-bfac-4562-ba8d-8c8e4207f869\") " Oct 29 23:27:26.949907 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.949865 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache" pod "c8581726-bfac-4562-ba8d-8c8e4207f869" (UID: "c8581726-bfac-4562-ba8d-8c8e4207f869"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:26.950091 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.950052 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir" pod "c8581726-bfac-4562-ba8d-8c8e4207f869" (UID: "c8581726-bfac-4562-ba8d-8c8e4207f869"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:26.950266 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.950242 6133 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-model-cache\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:26.950266 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.950269 6133 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-tmp-dir\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:26.950464 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.950243 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home" pod "c8581726-bfac-4562-ba8d-8c8e4207f869" (UID: "c8581726-bfac-4562-ba8d-8c8e4207f869"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:26.951720 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.951701 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm" pod "c8581726-bfac-4562-ba8d-8c8e4207f869" (UID: "c8581726-bfac-4562-ba8d-8c8e4207f869"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:26.951882 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.951867 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb" pod "c8581726-bfac-4562-ba8d-8c8e4207f869" (UID: "c8581726-bfac-4562-ba8d-8c8e4207f869"). InnerVolumeSpecName "kube-api-access-rnqfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:26.952040 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.952027 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs" pod "c8581726-bfac-4562-ba8d-8c8e4207f869" (UID: "c8581726-bfac-4562-ba8d-8c8e4207f869"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:26.999155 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.999122 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4"] Oct 29 23:27:26.999799 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.999779 6133 cpu_manager.go:414] "containerMap: removing container" podUID="c8581726-bfac-4562-ba8d-8c8e4207f869" containerName="main" Oct 29 23:27:26.999799 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.999798 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8581726-bfac-4562-ba8d-8c8e4207f869" containerName="main" Oct 29 23:27:26.999974 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:26.999899 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8581726-bfac-4562-ba8d-8c8e4207f869" containerName="main" Oct 29 23:27:27.003577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.003554 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.024066 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.023816 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4"] Oct 29 23:27:27.050950 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.050921 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051069 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.050973 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051069 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.050988 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051153 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051058 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051153 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051129 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051154 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051175 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjcj\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051346 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051314 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051392 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051355 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.051471 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051459 6133 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8581726-bfac-4562-ba8d-8c8e4207f869-tls-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:27.051503 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051473 6133 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-home\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:27.051503 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051482 6133 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8581726-bfac-4562-ba8d-8c8e4207f869-dshm\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:27.051503 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.051490 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnqfb\" (UniqueName: \"kubernetes.io/projected/c8581726-bfac-4562-ba8d-8c8e4207f869-kube-api-access-rnqfb\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:27.152296 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152253 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152345 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152362 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152380 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152425 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152411 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152533 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152609 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152580 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjcj\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152649 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152764 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152715 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152861 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152841 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.152930 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.152907 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.153014 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.153001 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.153122 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.153102 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.153563 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.153538 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.154813 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.154791 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.154893 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.154791 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.170130 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.170109 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.170474 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.170453 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjcj\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.332784 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.332751 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:27.559488 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.559419 6133 generic.go:356] "Generic (PLEG): container finished" podID="c8581726-bfac-4562-ba8d-8c8e4207f869" containerID="bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02" exitCode=0 Oct 29 23:27:27.559488 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.559464 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" Oct 29 23:27:27.559885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.559501 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" event={"ID":"c8581726-bfac-4562-ba8d-8c8e4207f869","Type":"ContainerDied","Data":"bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02"} Oct 29 23:27:27.559885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.559553 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc" event={"ID":"c8581726-bfac-4562-ba8d-8c8e4207f869","Type":"ContainerDied","Data":"c64f11150cc79eb151f3037d21f747a607466703ba999e5ea2671c5251985c00"} Oct 29 23:27:27.559885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.559580 6133 scope.go:122] "RemoveContainer" containerID="bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02" Oct 29 23:27:27.561278 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.561253 6133 generic.go:356] "Generic (PLEG): container finished" podID="3aa92d32-2ef7-4b57-8de0-8de4e24af86a" containerID="119a0a78426dddf61cd56388b7e7bc946ef9cd6398ecce69519b5f1930754c7f" exitCode=0 Oct 29 23:27:27.561409 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.561317 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" event={"ID":"3aa92d32-2ef7-4b57-8de0-8de4e24af86a","Type":"ContainerDied","Data":"119a0a78426dddf61cd56388b7e7bc946ef9cd6398ecce69519b5f1930754c7f"} Oct 29 23:27:27.568194 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.568168 6133 generic.go:356] "Generic (PLEG): container finished" podID="8d6872c2-b808-4c91-83d3-07f161e90ea0" containerID="132072f759c898fa73e572f3630e575e9546b58186aa9b2fdd194f3e38cc7bd9" exitCode=0 Oct 29 23:27:27.568326 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.568257 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" event={"ID":"8d6872c2-b808-4c91-83d3-07f161e90ea0","Type":"ContainerDied","Data":"132072f759c898fa73e572f3630e575e9546b58186aa9b2fdd194f3e38cc7bd9"} Oct 29 23:27:27.571105 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.571086 6133 scope.go:122] "RemoveContainer" containerID="bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02" Oct 29 23:27:27.571416 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:27.571395 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02\": container with ID starting with bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02 not found: ID does not exist" containerID="bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02" Oct 29 23:27:27.571510 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.571427 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02"} err="failed to get container status \"bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02\": rpc error: code = NotFound desc = could not find container \"bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02\": container with ID starting with bf6a39bfb832c30df06002c3875a3fdc0682bbe9d3f440c2b0a85e3273f99d02 not found: ID does not exist" Oct 29 23:27:27.671270 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.670999 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4"] Oct 29 23:27:27.675202 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:27.675167 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a6c471_fe2b_4357_89bc_1792d0b9d18e.slice/crio-9bf4eac4137fdfe50273956b3c84576862585289bf48222895f6b471eddfea88 WatchSource:0}: Error finding container 9bf4eac4137fdfe50273956b3c84576862585289bf48222895f6b471eddfea88: Status 404 returned error can't find the container with id 9bf4eac4137fdfe50273956b3c84576862585289bf48222895f6b471eddfea88 Oct 29 23:27:27.677742 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.677710 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:27:27.677840 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.677778 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:27:27.677912 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.677838 6133 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"} Oct 29 23:27:27.690757 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.690682 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc"] Oct 29 23:27:27.694071 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.694048 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-105882/premium-w3-105882-kserve-5b5f7f556f-6nffc"] Oct 29 23:27:27.957804 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:27.957771 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8581726-bfac-4562-ba8d-8c8e4207f869" path="/var/lib/kubelet/pods/c8581726-bfac-4562-ba8d-8c8e4207f869/volumes" Oct 29 23:27:28.606492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.606363 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" event={"ID":"75a6c471-fe2b-4357-89bc-1792d0b9d18e","Type":"ContainerStarted","Data":"0598d1abcdb62293de533d2e5bcb35dcc64d6063e660b22d99b95fdc29dff2dd"} Oct 29 23:27:28.606492 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.606456 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" event={"ID":"75a6c471-fe2b-4357-89bc-1792d0b9d18e","Type":"ContainerStarted","Data":"9bf4eac4137fdfe50273956b3c84576862585289bf48222895f6b471eddfea88"} Oct 29 23:27:28.659953 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.659886 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podStartSLOduration=2.659867019 podStartE2EDuration="2.659867019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:28.658831934 +0000 UTC m=+804.820019518" watchObservedRunningTime="2026-10-29 23:27:28.659867019 +0000 UTC m=+804.821054590" Oct 29 23:27:28.815005 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.814968 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:28.863171 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.863148 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:28.883314 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.874579 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p\" (UniqueName: \"kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p\") pod \"8d6872c2-b808-4c91-83d3-07f161e90ea0\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " Oct 29 23:27:28.883314 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.874667 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca\") pod \"8d6872c2-b808-4c91-83d3-07f161e90ea0\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " Oct 29 23:27:28.883314 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.874728 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca\") pod \"8d6872c2-b808-4c91-83d3-07f161e90ea0\" (UID: \"8d6872c2-b808-4c91-83d3-07f161e90ea0\") " Oct 29 23:27:28.884077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.883762 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca" pod "8d6872c2-b808-4c91-83d3-07f161e90ea0" (UID: "8d6872c2-b808-4c91-83d3-07f161e90ea0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:28.912870 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.911539 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p" pod "8d6872c2-b808-4c91-83d3-07f161e90ea0" (UID: "8d6872c2-b808-4c91-83d3-07f161e90ea0"). InnerVolumeSpecName "kube-api-access-jv79p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:28.912870 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.911734 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" podUID="4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" containerName="main" containerID="cri-o://5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36" gracePeriod=45 Oct 29 23:27:28.912870 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.912479 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca" pod "8d6872c2-b808-4c91-83d3-07f161e90ea0" (UID: "8d6872c2-b808-4c91-83d3-07f161e90ea0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.975581 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca\") pod \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.975645 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca\") pod \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.975786 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44\" (UniqueName: \"kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44\") pod \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\" (UID: \"3aa92d32-2ef7-4b57-8de0-8de4e24af86a\") " Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.976104 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv79p\" (UniqueName: \"kubernetes.io/projected/8d6872c2-b808-4c91-83d3-07f161e90ea0-kube-api-access-jv79p\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.976122 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.976137 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8d6872c2-b808-4c91-83d3-07f161e90ea0-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:28.985564 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.985498 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca" pod "3aa92d32-2ef7-4b57-8de0-8de4e24af86a" (UID: "3aa92d32-2ef7-4b57-8de0-8de4e24af86a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:28.994463 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.994410 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca" pod "3aa92d32-2ef7-4b57-8de0-8de4e24af86a" (UID: "3aa92d32-2ef7-4b57-8de0-8de4e24af86a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:28.997466 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:28.997422 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44" pod "3aa92d32-2ef7-4b57-8de0-8de4e24af86a" (UID: "3aa92d32-2ef7-4b57-8de0-8de4e24af86a"). InnerVolumeSpecName "kube-api-access-msf44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:29.082334 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.078944 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.082334 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.078981 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.082334 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.079001 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msf44\" (UniqueName: \"kubernetes.io/projected/3aa92d32-2ef7-4b57-8de0-8de4e24af86a-kube-api-access-msf44\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.284639 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.275686 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:27:29.355413 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.355332 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:29.356433 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.356407 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Oct 29 23:27:29.356637 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.356616 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Oct 29 23:27:29.391318 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.391276 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache\") pod \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " Oct 29 23:27:29.391825 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.391804 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs\" (UniqueName: \"kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs\") pod \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " Oct 29 23:27:29.391992 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.391975 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir\") pod \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " Oct 29 23:27:29.392152 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.392137 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w\" (UniqueName: \"kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w\") pod \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " Oct 29 23:27:29.392351 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.392335 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home\") pod \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " Oct 29 23:27:29.392473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.392460 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm\") pod \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\" (UID: \"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c\") " Oct 29 23:27:29.393632 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.391721 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache" pod "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" (UID: "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:29.393632 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.393348 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir" pod "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" (UID: "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:29.394033 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.394004 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home" pod "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" (UID: "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:29.401028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.400958 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs" pod "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" (UID: "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:29.402321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.402271 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w" pod "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" (UID: "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c"). InnerVolumeSpecName "kube-api-access-x8d5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:29.402510 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.402482 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm" pod "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" (UID: "4e5ba256-eaef-481f-bffb-84f3e4c1eb5c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:29.501132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.501004 6133 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tls-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.501132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.501044 6133 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-tmp-dir\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.501132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.501060 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8d5w\" (UniqueName: \"kubernetes.io/projected/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-kube-api-access-x8d5w\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.501132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.501073 6133 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-home\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.501132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.501089 6133 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-dshm\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.501132 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.501102 6133 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c-model-cache\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:29.613206 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.613171 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" Oct 29 23:27:29.613206 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.613178 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d998e766-jqpcb" event={"ID":"3aa92d32-2ef7-4b57-8de0-8de4e24af86a","Type":"ContainerDied","Data":"3e06f8102f71e86297a985afabc19b4badc69967293e4b8ecf17840e22f85c95"} Oct 29 23:27:29.613687 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.613226 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e06f8102f71e86297a985afabc19b4badc69967293e4b8ecf17840e22f85c95" Oct 29 23:27:29.614725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.614703 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" Oct 29 23:27:29.614725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.614715 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-893654db-zs9m6" event={"ID":"8d6872c2-b808-4c91-83d3-07f161e90ea0","Type":"ContainerDied","Data":"1bc5e34e692319243eb6f5491f82354144e767f892a1304de4dd400d5f96924b"} Oct 29 23:27:29.614911 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.614756 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bc5e34e692319243eb6f5491f82354144e767f892a1304de4dd400d5f96924b" Oct 29 23:27:29.616686 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.616661 6133 generic.go:356] "Generic (PLEG): container finished" podID="4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" containerID="5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36" exitCode=0 Oct 29 23:27:29.616801 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.616707 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" Oct 29 23:27:29.616801 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.616724 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" event={"ID":"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c","Type":"ContainerDied","Data":"5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36"} Oct 29 23:27:29.616801 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.616764 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl" event={"ID":"4e5ba256-eaef-481f-bffb-84f3e4c1eb5c","Type":"ContainerDied","Data":"ee639d28c4a2c6cdc3287d80f400ddf063575960955db79c58a4ce975883f61b"} Oct 29 23:27:29.616801 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.616788 6133 scope.go:122] "RemoveContainer" containerID="5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36" Oct 29 23:27:29.627249 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.627229 6133 scope.go:122] "RemoveContainer" containerID="5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36" Oct 29 23:27:29.627558 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:29.627540 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36\": container with ID starting with 5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36 not found: ID does not exist" containerID="5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36" Oct 29 23:27:29.627620 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.627564 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36"} err="failed to get container status \"5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36\": rpc error: code = NotFound desc = could not find container \"5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36\": container with ID starting with 5a911cde79853a5dba74b7b8d5a3267416b9ee9d1e23a4f0245a4e5868c2bb36 not found: ID does not exist" Oct 29 23:27:29.700360 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.698467 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl"] Oct 29 23:27:29.703265 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.703234 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/simulator-w0-b0153c-kserve-f755c6757-6r5wl"] Oct 29 23:27:29.957256 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:29.957178 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" path="/var/lib/kubelet/pods/4e5ba256-eaef-481f-bffb-84f3e4c1eb5c/volumes" Oct 29 23:27:30.333736 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:30.333649 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Oct 29 23:27:30.333736 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:30.333713 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Oct 29 23:27:31.333894 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:31.333861 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Oct 29 23:27:31.334328 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:31.333917 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Oct 29 23:27:32.333097 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:32.333060 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Oct 29 23:27:32.333267 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:32.333129 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Oct 29 23:27:33.334055 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:33.334015 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Oct 29 23:27:33.334533 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:33.334072 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Oct 29 23:27:34.333971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:34.333933 6133 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Oct 29 23:27:34.334148 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:34.333997 6133 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Oct 29 23:27:35.337446 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:35.337417 6133 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:35.337844 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:35.337791 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:35.338479 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:35.338460 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:27:37.070580 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:37.070551 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw"] Oct 29 23:27:37.071258 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:37.071192 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" containerID="cri-o://55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89" gracePeriod=30 Oct 29 23:27:38.807591 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:38.807555 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj"] Oct 29 23:27:38.819232 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:38.819202 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0153c-d8crj"] Oct 29 23:27:39.957371 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:39.957340 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="633e63ff-dbdf-4a60-9292-65640089adb3" path="/var/lib/kubelet/pods/633e63ff-dbdf-4a60-9292-65640089adb3/volumes" Oct 29 23:27:42.322058 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.322031 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:27:42.442528 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442496 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.442690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442558 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.442690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442620 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.442690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442684 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.442853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442754 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.442853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442795 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.442853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442809 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:42.443016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442837 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.443016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442863 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:42.443016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442938 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.443016 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.442978 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo\") pod \"2d52357b-4f71-4935-ae14-9990ac1dbc52\" (UID: \"2d52357b-4f71-4935-ae14-9990ac1dbc52\") " Oct 29 23:27:42.443225 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.443172 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:42.443316 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.443267 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:42.443395 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.443354 6133 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.443395 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.443357 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:42.443395 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.443376 6133 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-credential-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.445405 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.445356 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "kube-api-access-qnrs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:42.445979 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.445949 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:42.446799 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.446777 6133 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-workload-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.453345 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.453316 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:42.454715 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.454692 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo" pod "2d52357b-4f71-4935-ae14-9990ac1dbc52" (UID: "2d52357b-4f71-4935-ae14-9990ac1dbc52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:27:42.547567 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.547534 6133 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-token\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.547567 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.547562 6133 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-podinfo\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.547567 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.547572 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnrs4\" (UniqueName: \"kubernetes.io/projected/2d52357b-4f71-4935-ae14-9990ac1dbc52-kube-api-access-qnrs4\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.547827 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.547582 6133 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-envoy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.547827 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.547590 6133 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d52357b-4f71-4935-ae14-9990ac1dbc52-istio-data\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.547827 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.547597 6133 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d52357b-4f71-4935-ae14-9990ac1dbc52-istiod-ca-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:42.698355 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.698238 6133 generic.go:356] "Generic (PLEG): container finished" podID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerID="55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89" exitCode=0 Oct 29 23:27:42.698355 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.698323 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" Oct 29 23:27:42.698355 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.698320 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" event={"ID":"2d52357b-4f71-4935-ae14-9990ac1dbc52","Type":"ContainerDied","Data":"55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89"} Oct 29 23:27:42.698628 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.698419 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw" event={"ID":"2d52357b-4f71-4935-ae14-9990ac1dbc52","Type":"ContainerDied","Data":"3fc916322b68f0a66975a86cbf701eba088276c6a19b521f52ec6ceafcb00935"} Oct 29 23:27:42.698628 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.698453 6133 scope.go:122] "RemoveContainer" containerID="55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89" Oct 29 23:27:42.709783 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.709765 6133 scope.go:122] "RemoveContainer" containerID="335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed" Oct 29 23:27:42.721104 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.721087 6133 scope.go:122] "RemoveContainer" containerID="55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89" Oct 29 23:27:42.721368 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:42.721342 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89\": container with ID starting with 55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89 not found: ID does not exist" containerID="55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89" Oct 29 23:27:42.721465 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.721376 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89"} err="failed to get container status \"55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89\": rpc error: code = NotFound desc = could not find container \"55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89\": container with ID starting with 55551e22acbc406dcc9b1c69ade9c58c3f7bb0b3a1afac5b0fde2982727d3f89 not found: ID does not exist" Oct 29 23:27:42.721465 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.721394 6133 scope.go:122] "RemoveContainer" containerID="335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed" Oct 29 23:27:42.721695 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:42.721677 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed\": container with ID starting with 335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed not found: ID does not exist" containerID="335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed" Oct 29 23:27:42.721752 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.721700 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed"} err="failed to get container status \"335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed\": rpc error: code = NotFound desc = could not find container \"335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed\": container with ID starting with 335f4826ffe4500c03f3b8110f8d58227ee855050aa881057f67f6415951cbed not found: ID does not exist" Oct 29 23:27:42.747065 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.747036 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw"] Oct 29 23:27:42.757764 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:42.757745 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-b2c5f2-openshift-default-7dddcf87-s6hxw"] Oct 29 23:27:43.447892 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:43.447860 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:27:43.957478 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:43.957445 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" path="/var/lib/kubelet/pods/2d52357b-4f71-4935-ae14-9990ac1dbc52/volumes" Oct 29 23:27:45.433083 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:45.433008 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:27:47.922500 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:47.922461 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl"] Oct 29 23:27:47.922999 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:47.922656 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" containerID="cri-o://6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520" gracePeriod=30 Oct 29 23:27:51.920509 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.920461 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4"] Oct 29 23:27:51.921127 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921103 6133 cpu_manager.go:414] "containerMap: removing container" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" Oct 29 23:27:51.921199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921129 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" Oct 29 23:27:51.921199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921147 6133 cpu_manager.go:414] "containerMap: removing container" podUID="4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" containerName="main" Oct 29 23:27:51.921199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921156 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" containerName="main" Oct 29 23:27:51.921199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921181 6133 cpu_manager.go:414] "containerMap: removing container" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" Oct 29 23:27:51.921199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921190 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" Oct 29 23:27:51.921199 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921200 6133 cpu_manager.go:414] "containerMap: removing container" podUID="3aa92d32-2ef7-4b57-8de0-8de4e24af86a" containerName="revoke-keys" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921208 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aa92d32-2ef7-4b57-8de0-8de4e24af86a" containerName="revoke-keys" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921218 6133 cpu_manager.go:414] "containerMap: removing container" podUID="8d6872c2-b808-4c91-83d3-07f161e90ea0" containerName="revoke-keys" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921225 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8d6872c2-b808-4c91-83d3-07f161e90ea0" containerName="revoke-keys" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921402 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921417 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e5ba256-eaef-481f-bffb-84f3e4c1eb5c" containerName="main" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921428 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="3aa92d32-2ef7-4b57-8de0-8de4e24af86a" containerName="revoke-keys" Oct 29 23:27:51.921526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.921436 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="8d6872c2-b808-4c91-83d3-07f161e90ea0" containerName="revoke-keys" Oct 29 23:27:51.925270 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.925244 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:51.943534 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:51.943508 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4"] Oct 29 23:27:52.021630 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.021567 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:27:52.021905 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.021875 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:27:52.022064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.021954 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:27:52.022143 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.022070 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:27:52.050717 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.050685 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.050854 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.050824 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.050915 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.050881 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6h8z\" (UniqueName: \"kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.151402 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.151373 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.151541 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.151425 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6h8z\" (UniqueName: \"kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.151541 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.151494 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.152050 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.152032 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.153765 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.153745 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.169841 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.169820 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6h8z\" (UniqueName: \"kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z\") pod \"maas-api-revoke-sub-9d4611d2-tfsx4\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.242607 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.242543 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:52.544414 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.544345 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4"] Oct 29 23:27:52.547536 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:52.547508 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e0e8f4_97a1_48b4_a582_38f628d6a4c5.slice/crio-26e8aa63be3f666bd6bf6d47552036f924d2035673d417f819dd62d39ad0134e WatchSource:0}: Error finding container 26e8aa63be3f666bd6bf6d47552036f924d2035673d417f819dd62d39ad0134e: Status 404 returned error can't find the container with id 26e8aa63be3f666bd6bf6d47552036f924d2035673d417f819dd62d39ad0134e Oct 29 23:27:52.776027 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:52.775996 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" event={"ID":"94e0e8f4-97a1-48b4-a582-38f628d6a4c5","Type":"ContainerStarted","Data":"26e8aa63be3f666bd6bf6d47552036f924d2035673d417f819dd62d39ad0134e"} Oct 29 23:27:53.180357 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.180330 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:27:53.363514 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363480 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363706 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363546 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363706 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363616 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363706 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363653 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363706 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363677 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363735 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363751 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.363944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363768 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363830 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.363944 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.363905 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token\") pod \"049c73e1-62d3-42f3-a34b-463380b9a3d9\" (UID: \"049c73e1-62d3-42f3-a34b-463380b9a3d9\") " Oct 29 23:27:53.364190 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364026 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.364253 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364186 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.364365 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364231 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:53.364606 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364582 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.364761 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364739 6133 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.364850 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364768 6133 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-data\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.364850 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364783 6133 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/049c73e1-62d3-42f3-a34b-463380b9a3d9-istiod-ca-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.364850 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364798 6133 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-credential-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.364850 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.364813 6133 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-workload-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.365928 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.365903 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:27:53.366045 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.366029 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "kube-api-access-k8wxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:53.366219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.366203 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:27:53.366367 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.366350 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token" pod "049c73e1-62d3-42f3-a34b-463380b9a3d9" (UID: "049c73e1-62d3-42f3-a34b-463380b9a3d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:53.465454 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.465395 6133 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-podinfo\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.465454 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.465419 6133 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-token\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.465454 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.465427 6133 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/049c73e1-62d3-42f3-a34b-463380b9a3d9-istio-envoy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.465454 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.465437 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8wxs\" (UniqueName: \"kubernetes.io/projected/049c73e1-62d3-42f3-a34b-463380b9a3d9-kube-api-access-k8wxs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:53.783557 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.783479 6133 generic.go:356] "Generic (PLEG): container finished" podID="94e0e8f4-97a1-48b4-a582-38f628d6a4c5" containerID="8d1db725a592998a8679e5c7e42ea32f969ba291b00f7eddbfbd74ea60003811" exitCode=0 Oct 29 23:27:53.783704 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.783568 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" event={"ID":"94e0e8f4-97a1-48b4-a582-38f628d6a4c5","Type":"ContainerDied","Data":"8d1db725a592998a8679e5c7e42ea32f969ba291b00f7eddbfbd74ea60003811"} Oct 29 23:27:53.784993 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.784969 6133 generic.go:356] "Generic (PLEG): container finished" podID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerID="6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520" exitCode=0 Oct 29 23:27:53.785084 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.785018 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" Oct 29 23:27:53.785084 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.785050 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" event={"ID":"049c73e1-62d3-42f3-a34b-463380b9a3d9","Type":"ContainerDied","Data":"6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520"} Oct 29 23:27:53.785174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.785093 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl" event={"ID":"049c73e1-62d3-42f3-a34b-463380b9a3d9","Type":"ContainerDied","Data":"db65aa0c291633fc849d362d130e69d348bcbcc28ee690546fce9f180f95969c"} Oct 29 23:27:53.785174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.785116 6133 scope.go:122] "RemoveContainer" containerID="6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520" Oct 29 23:27:53.795773 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.795759 6133 scope.go:122] "RemoveContainer" containerID="6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520" Oct 29 23:27:53.796021 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:27:53.795997 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520\": container with ID starting with 6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520 not found: ID does not exist" containerID="6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520" Oct 29 23:27:53.796088 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.796030 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520"} err="failed to get container status \"6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520\": rpc error: code = NotFound desc = could not find container \"6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520\": container with ID starting with 6d626caef28218d5ffe449b0a2441514b0e3dc9c0477a09a79931db646bc1520 not found: ID does not exist" Oct 29 23:27:53.862651 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.862624 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl"] Oct 29 23:27:53.872159 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.872134 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-bnjdl"] Oct 29 23:27:53.957865 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:53.957842 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" path="/var/lib/kubelet/pods/049c73e1-62d3-42f3-a34b-463380b9a3d9/volumes" Oct 29 23:27:54.955394 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:54.955370 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:55.080133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.080055 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca\") pod \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " Oct 29 23:27:55.080133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.080091 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z\" (UniqueName: \"kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z\") pod \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " Oct 29 23:27:55.080380 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.080210 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca\") pod \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\" (UID: \"94e0e8f4-97a1-48b4-a582-38f628d6a4c5\") " Oct 29 23:27:55.080729 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.080692 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca" pod "94e0e8f4-97a1-48b4-a582-38f628d6a4c5" (UID: "94e0e8f4-97a1-48b4-a582-38f628d6a4c5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:27:55.082343 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.082311 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z" pod "94e0e8f4-97a1-48b4-a582-38f628d6a4c5" (UID: "94e0e8f4-97a1-48b4-a582-38f628d6a4c5"). InnerVolumeSpecName "kube-api-access-t6h8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:27:55.082441 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.082344 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca" pod "94e0e8f4-97a1-48b4-a582-38f628d6a4c5" (UID: "94e0e8f4-97a1-48b4-a582-38f628d6a4c5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:27:55.181578 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.181547 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:55.181578 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.181573 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6h8z\" (UniqueName: \"kubernetes.io/projected/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-kube-api-access-t6h8z\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:55.181578 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.181584 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/94e0e8f4-97a1-48b4-a582-38f628d6a4c5-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:27:55.806428 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.804184 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" event={"ID":"94e0e8f4-97a1-48b4-a582-38f628d6a4c5","Type":"ContainerDied","Data":"26e8aa63be3f666bd6bf6d47552036f924d2035673d417f819dd62d39ad0134e"} Oct 29 23:27:55.806428 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.804261 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26e8aa63be3f666bd6bf6d47552036f924d2035673d417f819dd62d39ad0134e" Oct 29 23:27:55.806428 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:55.804364 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9d4611d2-tfsx4" Oct 29 23:27:56.278219 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:56.278180 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:27:57.528696 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.528664 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc"] Oct 29 23:27:57.529133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529083 6133 cpu_manager.go:414] "containerMap: removing container" podUID="94e0e8f4-97a1-48b4-a582-38f628d6a4c5" containerName="revoke-keys" Oct 29 23:27:57.529133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529095 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="94e0e8f4-97a1-48b4-a582-38f628d6a4c5" containerName="revoke-keys" Oct 29 23:27:57.529133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529123 6133 cpu_manager.go:414] "containerMap: removing container" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" Oct 29 23:27:57.529133 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529128 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" Oct 29 23:27:57.529260 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529182 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="94e0e8f4-97a1-48b4-a582-38f628d6a4c5" containerName="revoke-keys" Oct 29 23:27:57.529260 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529194 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="049c73e1-62d3-42f3-a34b-463380b9a3d9" containerName="istio-proxy" Oct 29 23:27:57.529260 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.529199 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d52357b-4f71-4935-ae14-9990ac1dbc52" containerName="istio-proxy" Oct 29 23:27:57.532552 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.532533 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.555481 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.555451 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc"] Oct 29 23:27:57.564116 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.564085 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 29 23:27:57.564566 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.564524 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\"" Oct 29 23:27:57.606584 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.606550 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6gq\" (UniqueName: \"kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.606721 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.606601 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.606721 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.606708 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.614986 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.614966 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 29 23:27:57.615136 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.615033 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 29 23:27:57.707233 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.707207 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6gq\" (UniqueName: \"kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.707357 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.707247 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.707357 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.707325 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.707910 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.707881 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.709667 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.709646 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.727205 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.727178 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6gq\" (UniqueName: \"kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq\") pod \"maas-api-revoke-sub-a15a66c9-g7mrc\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:57.856860 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:57.856788 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:27:58.160803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:58.160772 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc"] Oct 29 23:27:58.161496 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:27:58.161464 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9765b260_25b5_4369_becf_c691bc88e846.slice/crio-560b8c24db171f38462edc14075ff3bf9080ed7a78d984114a3f356da5ce621c WatchSource:0}: Error finding container 560b8c24db171f38462edc14075ff3bf9080ed7a78d984114a3f356da5ce621c: Status 404 returned error can't find the container with id 560b8c24db171f38462edc14075ff3bf9080ed7a78d984114a3f356da5ce621c Oct 29 23:27:58.824625 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:58.824545 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" event={"ID":"9765b260-25b5-4369-becf-c691bc88e846","Type":"ContainerStarted","Data":"46772fab1ada68bf39f3c84a85481e72235f9ab981980cd5fec2f2c3cfc5ee53"} Oct 29 23:27:58.824625 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:58.824596 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" event={"ID":"9765b260-25b5-4369-becf-c691bc88e846","Type":"ContainerStarted","Data":"560b8c24db171f38462edc14075ff3bf9080ed7a78d984114a3f356da5ce621c"} Oct 29 23:27:58.864683 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:58.864636 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" podStartSLOduration=1.864619553 podStartE2EDuration="1.864619553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:58.862607422 +0000 UTC m=+835.023794992" watchObservedRunningTime="2026-10-29 23:27:58.864619553 +0000 UTC m=+835.025807125" Oct 29 23:27:59.832039 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:59.832004 6133 generic.go:356] "Generic (PLEG): container finished" podID="9765b260-25b5-4369-becf-c691bc88e846" containerID="46772fab1ada68bf39f3c84a85481e72235f9ab981980cd5fec2f2c3cfc5ee53" exitCode=0 Oct 29 23:27:59.832477 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:27:59.832094 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" event={"ID":"9765b260-25b5-4369-becf-c691bc88e846","Type":"ContainerDied","Data":"46772fab1ada68bf39f3c84a85481e72235f9ab981980cd5fec2f2c3cfc5ee53"} Oct 29 23:28:00.970239 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:00.970214 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:28:01.038536 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.038507 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq\" (UniqueName: \"kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq\") pod \"9765b260-25b5-4369-becf-c691bc88e846\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " Oct 29 23:28:01.038536 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.038539 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca\") pod \"9765b260-25b5-4369-becf-c691bc88e846\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " Oct 29 23:28:01.038693 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.038594 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca\") pod \"9765b260-25b5-4369-becf-c691bc88e846\" (UID: \"9765b260-25b5-4369-becf-c691bc88e846\") " Oct 29 23:28:01.039011 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.038988 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca" pod "9765b260-25b5-4369-becf-c691bc88e846" (UID: "9765b260-25b5-4369-becf-c691bc88e846"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:01.040499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.040468 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq" pod "9765b260-25b5-4369-becf-c691bc88e846" (UID: "9765b260-25b5-4369-becf-c691bc88e846"). InnerVolumeSpecName "kube-api-access-2x6gq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:01.040695 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.040671 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca" pod "9765b260-25b5-4369-becf-c691bc88e846" (UID: "9765b260-25b5-4369-becf-c691bc88e846"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 29 23:28:01.139804 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.139782 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x6gq\" (UniqueName: \"kubernetes.io/projected/9765b260-25b5-4369-becf-c691bc88e846-kube-api-access-2x6gq\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:01.139804 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.139805 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9765b260-25b5-4369-becf-c691bc88e846-maas-api-xks-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:01.139953 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.139816 6133 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9765b260-25b5-4369-becf-c691bc88e846-maas-api-openshift-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:01.845611 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.845582 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" Oct 29 23:28:01.845776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.845576 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a15a66c9-g7mrc" event={"ID":"9765b260-25b5-4369-becf-c691bc88e846","Type":"ContainerDied","Data":"560b8c24db171f38462edc14075ff3bf9080ed7a78d984114a3f356da5ce621c"} Oct 29 23:28:01.845776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:01.845711 6133 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="560b8c24db171f38462edc14075ff3bf9080ed7a78d984114a3f356da5ce621c" Oct 29 23:28:07.341751 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:07.341710 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:28:12.109032 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:12.109001 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8"] Oct 29 23:28:12.109611 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:12.109206 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" containerID="cri-o://c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869" gracePeriod=30 Oct 29 23:28:12.317015 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:12.316980 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:28:13.455035 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:28:13.455002 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:28:17.368060 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.368033 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:28:17.491047 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.490966 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491047 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491006 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491057 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491078 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491137 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491167 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491214 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491294 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491349 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491335 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb\") pod \"f51f772e-f42b-4ccf-8399-a27c6a6de564\" (UID: \"f51f772e-f42b-4ccf-8399-a27c6a6de564\") " Oct 29 23:28:17.491689 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491386 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:17.491689 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491395 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:17.491689 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491647 6133 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.491689 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491666 6133 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f51f772e-f42b-4ccf-8399-a27c6a6de564-istiod-ca-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.491883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491712 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:17.491883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491728 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:17.491883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.491813 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:17.493705 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.493653 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:17.493988 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.493957 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:28:17.494113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.493994 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "kube-api-access-8q9tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:17.494113 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.493992 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy" pod "f51f772e-f42b-4ccf-8399-a27c6a6de564" (UID: "f51f772e-f42b-4ccf-8399-a27c6a6de564"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:17.592712 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592674 6133 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-token\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.592712 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592712 6133 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-credential-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.592902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592728 6133 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-podinfo\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.592902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592742 6133 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-envoy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.592902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592756 6133 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-workload-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.592902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592768 6133 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f51f772e-f42b-4ccf-8399-a27c6a6de564-istio-data\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.592902 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.592782 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q9tb\" (UniqueName: \"kubernetes.io/projected/f51f772e-f42b-4ccf-8399-a27c6a6de564-kube-api-access-8q9tb\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:17.940608 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.940568 6133 generic.go:356] "Generic (PLEG): container finished" podID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerID="c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869" exitCode=0 Oct 29 23:28:17.940798 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.940624 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" Oct 29 23:28:17.940798 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.940658 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" event={"ID":"f51f772e-f42b-4ccf-8399-a27c6a6de564","Type":"ContainerDied","Data":"c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869"} Oct 29 23:28:17.940798 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.940724 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8" event={"ID":"f51f772e-f42b-4ccf-8399-a27c6a6de564","Type":"ContainerDied","Data":"18a08ff102b96c7bcd7fc027da91104fd20347dfae779d5d8bacea0c4ce78ebf"} Oct 29 23:28:17.940798 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.940758 6133 scope.go:122] "RemoveContainer" containerID="c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869" Oct 29 23:28:17.950699 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.950682 6133 scope.go:122] "RemoveContainer" containerID="c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869" Oct 29 23:28:17.950990 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:28:17.950967 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869\": container with ID starting with c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869 not found: ID does not exist" containerID="c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869" Oct 29 23:28:17.951076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:17.951004 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869"} err="failed to get container status \"c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869\": rpc error: code = NotFound desc = could not find container \"c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869\": container with ID starting with c8ac79ba84d517216566ee49d6dd5c34051bc5f9d2718f0229e5e8c878b2c869 not found: ID does not exist" Oct 29 23:28:18.003690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:18.003667 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8"] Oct 29 23:28:18.014520 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:18.014499 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-kvqz8"] Oct 29 23:28:19.149970 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:19.149769 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-lhm9b"] Oct 29 23:28:19.956193 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:19.956160 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" path="/var/lib/kubelet/pods/f51f772e-f42b-4ccf-8399-a27c6a6de564/volumes" Oct 29 23:28:20.707666 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:20.707627 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm"] Oct 29 23:28:20.708076 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:20.707912 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" containerID="cri-o://333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983" gracePeriod=30 Oct 29 23:28:20.720397 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:20.720368 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4"] Oct 29 23:28:20.720870 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:20.720693 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" containerID="cri-o://0598d1abcdb62293de533d2e5bcb35dcc64d6063e660b22d99b95fdc29dff2dd" gracePeriod=30 Oct 29 23:28:22.261859 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:22.261829 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-j2b9b_0471e557-49fa-40fc-9266-f985ac58d510/manager/0.log" Oct 29 23:28:22.767327 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:22.767276 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-xsd7z_d62f7a32-a650-47f1-a8fc-ad343fe9bce8/manager/0.log" Oct 29 23:28:23.000475 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:23.000435 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-lhm9b_a3583c9a-51af-497b-af11-5d5f27525f05/limitador/0.log" Oct 29 23:28:24.080443 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:24.080416 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:28:24.481322 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:24.481276 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:28:24.970408 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:24.970382 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:28:25.152860 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.152835 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:28:25.973077 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.973054 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:28:25.987483 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.987457 6133 generic.go:356] "Generic (PLEG): container finished" podID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerID="0598d1abcdb62293de533d2e5bcb35dcc64d6063e660b22d99b95fdc29dff2dd" exitCode=0 Oct 29 23:28:25.987600 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.987533 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" event={"ID":"75a6c471-fe2b-4357-89bc-1792d0b9d18e","Type":"ContainerDied","Data":"0598d1abcdb62293de533d2e5bcb35dcc64d6063e660b22d99b95fdc29dff2dd"} Oct 29 23:28:25.988955 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.988931 6133 generic.go:356] "Generic (PLEG): container finished" podID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerID="333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983" exitCode=0 Oct 29 23:28:25.989064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.988984 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" Oct 29 23:28:25.989064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.989000 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" event={"ID":"b2bf6a12-08eb-497e-a424-d9b3d90a3a62","Type":"ContainerDied","Data":"333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983"} Oct 29 23:28:25.989064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.989039 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm" event={"ID":"b2bf6a12-08eb-497e-a424-d9b3d90a3a62","Type":"ContainerDied","Data":"be776ee76e0034c7b7d3dbbc977c5f92d0e5426b7fcc5d81507ecb0058959971"} Oct 29 23:28:25.989213 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.989065 6133 scope.go:122] "RemoveContainer" containerID="333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983" Oct 29 23:28:25.999433 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.999418 6133 scope.go:122] "RemoveContainer" containerID="333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983" Oct 29 23:28:25.999696 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:28:25.999678 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983\": container with ID starting with 333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983 not found: ID does not exist" containerID="333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983" Oct 29 23:28:25.999766 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:25.999709 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983"} err="failed to get container status \"333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983\": rpc error: code = NotFound desc = could not find container \"333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983\": container with ID starting with 333bb13ef10db175d65b8557124687d370f0d236dec327760990725ce57e2983 not found: ID does not exist" Oct 29 23:28:26.000575 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.000557 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:28:26.066109 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066072 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066278 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066128 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066278 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066166 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066278 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066236 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066274 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066370 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066442 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.066473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066454 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066528 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066560 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert\") pod \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\" (UID: \"b2bf6a12-08eb-497e-a424-d9b3d90a3a62\") " Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066602 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066799 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066920 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066938 6133 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-credential-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066961 6133 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-data\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.066975 6133 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.067363 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.067210 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:26.069276 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.069253 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.069551 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.069527 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:28:26.069620 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.069553 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:26.071496 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.071475 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc" pod "b2bf6a12-08eb-497e-a424-d9b3d90a3a62" (UID: "b2bf6a12-08eb-497e-a424-d9b3d90a3a62"). InnerVolumeSpecName "kube-api-access-j5plc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:26.167502 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167471 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167518 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167560 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167582 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167602 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167698 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167731 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167744 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167769 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.167923 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167828 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token\") pod \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\" (UID: \"75a6c471-fe2b-4357-89bc-1792d0b9d18e\") " Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.167956 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168121 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168170 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168196 6133 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istiod-ca-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168217 6133 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-podinfo\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168232 6133 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-envoy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168245 6133 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-data\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168258 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5plc\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-kube-api-access-j5plc\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168271 6133 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168305 6133 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-istio-token\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168427 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168320 6133 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2bf6a12-08eb-497e-a424-d9b3d90a3a62-workload-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.168816 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.168430 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.169676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.169651 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:28:26.169916 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.169897 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:26.170191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.170172 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:28:26.170191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.170180 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj" pod "75a6c471-fe2b-4357-89bc-1792d0b9d18e" (UID: "75a6c471-fe2b-4357-89bc-1792d0b9d18e"). InnerVolumeSpecName "kube-api-access-qpjcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269112 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpjcj\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-kube-api-access-qpjcj\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269140 6133 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-podinfo\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269150 6133 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-credential-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269162 6133 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istiod-ca-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269175 6133 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-workload-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269183 6133 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-token\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.269191 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.269190 6133 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75a6c471-fe2b-4357-89bc-1792d0b9d18e-istio-envoy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:28:26.333028 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.332996 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm"] Oct 29 23:28:26.338044 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:26.338018 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-gzsxm"] Oct 29 23:28:27.005596 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.005513 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" event={"ID":"75a6c471-fe2b-4357-89bc-1792d0b9d18e","Type":"ContainerDied","Data":"9bf4eac4137fdfe50273956b3c84576862585289bf48222895f6b471eddfea88"} Oct 29 23:28:27.005596 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.005563 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4" Oct 29 23:28:27.005596 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.005593 6133 scope.go:122] "RemoveContainer" containerID="0598d1abcdb62293de533d2e5bcb35dcc64d6063e660b22d99b95fdc29dff2dd" Oct 29 23:28:27.053147 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.053120 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4"] Oct 29 23:28:27.064401 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.064376 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-ww4v4"] Oct 29 23:28:27.956473 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.956446 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" path="/var/lib/kubelet/pods/75a6c471-fe2b-4357-89bc-1792d0b9d18e/volumes" Oct 29 23:28:27.956870 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:27.956856 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" path="/var/lib/kubelet/pods/b2bf6a12-08eb-497e-a424-d9b3d90a3a62/volumes" Oct 29 23:28:36.362505 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:36.362480 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:28:36.786496 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:36.786426 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:28:37.282805 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:37.282783 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:28:37.459447 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:37.459422 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:28:38.615630 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:38.615603 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-21d0cccf-z9bqq_95e2fda1-dd37-4b6d-b621-f4e6f120e2ce/revoke-keys/0.log" Oct 29 23:28:39.337934 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:39.337899 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4c54a363-89z9n_49e8ef98-05d2-415b-8205-8831959c9b44/revoke-keys/0.log" Oct 29 23:28:39.517174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:39.517147 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4c83377c-tr6ts_c123cfb2-7270-4dd3-b9e9-e5c7c75da96a/revoke-keys/0.log" Oct 29 23:28:40.051772 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:40.051746 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-5d48b012-w2bpd_066a2b3b-0226-441f-886a-0ba38068bb87/revoke-keys/0.log" Oct 29 23:28:40.416803 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:40.416772 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-893654db-zs9m6_8d6872c2-b808-4c91-83d3-07f161e90ea0/revoke-keys/0.log" Oct 29 23:28:40.941129 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:40.941104 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9d4611d2-tfsx4_94e0e8f4-97a1-48b4-a582-38f628d6a4c5/revoke-keys/0.log" Oct 29 23:28:41.130526 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:41.130498 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-a15a66c9-g7mrc_9765b260-25b5-4369-becf-c691bc88e846/revoke-keys/0.log" Oct 29 23:28:41.653582 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:41.653547 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d998e766-jqpcb_3aa92d32-2ef7-4b57-8de0-8de4e24af86a/revoke-keys/0.log" Oct 29 23:28:43.447806 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:28:43.447775 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:28:43.713145 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:43.713017 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-j2b9b_0471e557-49fa-40fc-9266-f985ac58d510/manager/0.log" Oct 29 23:28:44.197451 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:44.197418 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-xsd7z_d62f7a32-a650-47f1-a8fc-ad343fe9bce8/manager/0.log" Oct 29 23:28:44.444319 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:44.444265 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-lhm9b_a3583c9a-51af-497b-af11-5d5f27525f05/limitador/0.log" Oct 29 23:28:45.751499 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:45.751466 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:28:46.118471 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:46.118447 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:28:46.683861 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:46.683825 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/1.log" Oct 29 23:28:47.970516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:28:47.970489 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/0.log" Oct 29 23:29:04.078638 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:04.078611 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:29:04.087160 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:04.087141 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sg8lq_2ca48acc-d5eb-434b-b8a3-e77928817c78/ovn-acl-logging/0.log" Oct 29 23:29:04.198007 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:04.197987 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rrcsq_f97e9991-dae4-4dfd-a57e-02842e3097f0/global-pull-secret-syncer/0.log" Oct 29 23:29:04.947295 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:04.947249 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdkfv_3696b0b9-b3d7-479f-be52-853834548a9a/konnectivity-agent/0.log" Oct 29 23:29:05.321017 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:05.320951 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-10.ec2.internal_cb762aa62d1c58eba273642f34f2f74a/haproxy/0.log" Oct 29 23:29:08.675467 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:08.675432 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:08.736444 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:08.736417 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:08.868627 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:08.868607 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:08.933740 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:08.933670 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:09.092174 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:09.092150 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:09.248867 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:09.248800 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:09.293838 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:09.293815 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:09.440374 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:09.440351 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:10.779409 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:10.779380 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:10.973297 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:10.973261 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:11.107967 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:11.107900 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:11.120885 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:11.120808 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:11.322147 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:11.322121 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:11.328256 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:11.328232 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:11.466462 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:11.466435 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:11.679911 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:11.679880 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:12.152778 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:12.152742 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-j2b9b_0471e557-49fa-40fc-9266-f985ac58d510/manager/0.log" Oct 29 23:29:12.470486 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:12.470394 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-xsd7z_d62f7a32-a650-47f1-a8fc-ad343fe9bce8/manager/0.log" Oct 29 23:29:12.614971 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:12.614940 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-lhm9b_a3583c9a-51af-497b-af11-5d5f27525f05/limitador/0.log" Oct 29 23:29:12.825957 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:12.825851 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:13.004664 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.004632 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:13.138147 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.138110 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:13.200319 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.200278 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:13.351229 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.351204 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:13.428212 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.428147 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:13.450938 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:29:13.450911 6133 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xbqbf" containerName="extractor" Oct 29 23:29:13.488555 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.488538 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:13.691717 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:13.691652 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:14.281043 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281008 6133 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5"] Oct 29 23:29:14.281436 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281422 6133 cpu_manager.go:414] "containerMap: removing container" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" Oct 29 23:29:14.281436 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281435 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" Oct 29 23:29:14.281516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281444 6133 cpu_manager.go:414] "containerMap: removing container" podUID="9765b260-25b5-4369-becf-c691bc88e846" containerName="revoke-keys" Oct 29 23:29:14.281516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281450 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9765b260-25b5-4369-becf-c691bc88e846" containerName="revoke-keys" Oct 29 23:29:14.281516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281468 6133 cpu_manager.go:414] "containerMap: removing container" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" Oct 29 23:29:14.281516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281473 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" Oct 29 23:29:14.281516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281487 6133 cpu_manager.go:414] "containerMap: removing container" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" Oct 29 23:29:14.281516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281491 6133 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" Oct 29 23:29:14.281690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281548 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="75a6c471-fe2b-4357-89bc-1792d0b9d18e" containerName="istio-proxy" Oct 29 23:29:14.281690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281557 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="b2bf6a12-08eb-497e-a424-d9b3d90a3a62" containerName="istio-proxy" Oct 29 23:29:14.281690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281566 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="f51f772e-f42b-4ccf-8399-a27c6a6de564" containerName="istio-proxy" Oct 29 23:29:14.281690 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.281572 6133 memory_manager.go:365] "RemoveStaleState removing state" podUID="9765b260-25b5-4369-becf-c691bc88e846" containerName="revoke-keys" Oct 29 23:29:14.283268 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.283242 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/alertmanager/0.log" Oct 29 23:29:14.284577 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.284554 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.305671 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.305648 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5"] Oct 29 23:29:14.348053 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.348031 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-proc\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.348158 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.348061 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-sys\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.348158 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.348077 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-podres\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.348235 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.348150 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-lib-modules\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.348235 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.348200 6133 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbz8l\" (UniqueName: \"kubernetes.io/projected/883bd770-b138-4666-a60d-dd43150bd115-kube-api-access-kbz8l\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.390537 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.390514 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vz8b8\"/\"kube-root-ca.crt\"" Oct 29 23:29:14.390537 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.390523 6133 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vz8b8\"/\"default-dockercfg-bwshg\"" Oct 29 23:29:14.390725 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.390562 6133 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vz8b8\"/\"openshift-service-ca.crt\"" Oct 29 23:29:14.391156 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.391139 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/config-reloader/0.log" Oct 29 23:29:14.448903 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.448884 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-lib-modules\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.448998 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.448914 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbz8l\" (UniqueName: \"kubernetes.io/projected/883bd770-b138-4666-a60d-dd43150bd115-kube-api-access-kbz8l\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.448998 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.448988 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-proc\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.449070 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.449016 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-sys\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.449070 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.449016 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-lib-modules\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.449070 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.449051 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-sys\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.449162 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.449081 6133 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-podres\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.449162 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.449143 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-podres\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.449226 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.449196 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/883bd770-b138-4666-a60d-dd43150bd115-proc\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.467648 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.467625 6133 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbz8l\" (UniqueName: \"kubernetes.io/projected/883bd770-b138-4666-a60d-dd43150bd115-kube-api-access-kbz8l\") pod \"perf-node-gather-daemonset-kv8q5\" (UID: \"883bd770-b138-4666-a60d-dd43150bd115\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.505022 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.505003 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/kube-rbac-proxy-web/0.log" Oct 29 23:29:14.596180 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.596130 6133 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:14.614433 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.614409 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/kube-rbac-proxy/0.log" Oct 29 23:29:14.749642 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.749615 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/kube-rbac-proxy-metric/0.log" Oct 29 23:29:14.869574 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.869548 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/prom-label-proxy/0.log" Oct 29 23:29:14.893676 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.893650 6133 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5"] Oct 29 23:29:14.897375 ip-10-0-143-10 kubenswrapper[6133]: W1029 23:29:14.897350 6133 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod883bd770_b138_4666_a60d_dd43150bd115.slice/crio-80e143af53763725ca777ea1819f7dd0dd93931ea4ab74642cb70df0171fbf98 WatchSource:0}: Error finding container 80e143af53763725ca777ea1819f7dd0dd93931ea4ab74642cb70df0171fbf98: Status 404 returned error can't find the container with id 80e143af53763725ca777ea1819f7dd0dd93931ea4ab74642cb70df0171fbf98 Oct 29 23:29:14.974663 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:14.974643 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_807b5b9e-91d7-4478-bc6f-4e867c35b91d/init-config-reloader/0.log" Oct 29 23:29:15.279111 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.279026 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" event={"ID":"883bd770-b138-4666-a60d-dd43150bd115","Type":"ContainerStarted","Data":"96042c0ac4a16f2ef74446251b8ee95ed7f7cdf15dedd40302492762214c02b3"} Oct 29 23:29:15.279111 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.279078 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" event={"ID":"883bd770-b138-4666-a60d-dd43150bd115","Type":"ContainerStarted","Data":"80e143af53763725ca777ea1819f7dd0dd93931ea4ab74642cb70df0171fbf98"} Oct 29 23:29:15.279403 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.279183 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:15.316869 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.316823 6133 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" podStartSLOduration=1.316810301 podStartE2EDuration="1.316810301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:15.315754197 +0000 UTC m=+911.476941766" watchObservedRunningTime="2026-10-29 23:29:15.316810301 +0000 UTC m=+911.477997909" Oct 29 23:29:15.582806 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.582742 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66f6cfc57-5f9nh_b2dce7a8-100f-44e1-8409-42b42eef282f/metrics-server/0.log" Oct 29 23:29:15.643806 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.643776 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:15.773853 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.773830 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:15.963202 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.963179 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:15.969929 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.969909 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/0.log" Oct 29 23:29:15.970321 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:15.970302 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/1.log" Oct 29 23:29:16.089027 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.088993 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:16.276970 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.276903 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/0.log" Oct 29 23:29:16.277267 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.277250 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/1.log" Oct 29 23:29:16.498302 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.498268 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j55lx_270efdc7-7967-4f7d-b4f6-b37bc80716e8/node-exporter/0.log" Oct 29 23:29:16.599782 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.599728 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j55lx_270efdc7-7967-4f7d-b4f6-b37bc80716e8/kube-rbac-proxy/0.log" Oct 29 23:29:16.734206 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.734186 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j55lx_270efdc7-7967-4f7d-b4f6-b37bc80716e8/init-textfile/0.log" Oct 29 23:29:16.861744 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.861728 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-2cvsp_3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/kube-rbac-proxy-main/0.log" Oct 29 23:29:16.964811 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:16.964792 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-2cvsp_3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/kube-rbac-proxy-self/0.log" Oct 29 23:29:17.067883 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.067866 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-2cvsp_3213b0b3-2cd9-4c0b-b2be-0b9d6b043fb2/openshift-state-metrics/0.log" Oct 29 23:29:17.181817 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.181750 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/prometheus/0.log" Oct 29 23:29:17.284845 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.284824 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/config-reloader/0.log" Oct 29 23:29:17.386800 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.386777 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/thanos-sidecar/0.log" Oct 29 23:29:17.489170 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.489113 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/kube-rbac-proxy-web/0.log" Oct 29 23:29:17.591036 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.591009 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/kube-rbac-proxy/0.log" Oct 29 23:29:17.695776 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.695750 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/kube-rbac-proxy-thanos/0.log" Oct 29 23:29:17.799855 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:17.799793 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec301c73-02e5-4cc5-82b9-bdcafee2988b/init-config-reloader/0.log" Oct 29 23:29:18.295491 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:18.295469 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-j2b9b_0471e557-49fa-40fc-9266-f985ac58d510/manager/0.log" Oct 29 23:29:18.505658 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:18.505628 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-xsd7z_d62f7a32-a650-47f1-a8fc-ad343fe9bce8/manager/0.log" Oct 29 23:29:18.540127 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:18.540104 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-j2b9b_0471e557-49fa-40fc-9266-f985ac58d510/manager/0.log" Oct 29 23:29:18.560035 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:18.559982 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-lhm9b_a3583c9a-51af-497b-af11-5d5f27525f05/limitador/0.log" Oct 29 23:29:18.726471 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:18.726436 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-xsd7z_d62f7a32-a650-47f1-a8fc-ad343fe9bce8/manager/0.log" Oct 29 23:29:18.764856 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:18.764827 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-lhm9b_a3583c9a-51af-497b-af11-5d5f27525f05/limitador/0.log" Oct 29 23:29:21.293958 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:21.293931 6133 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-kv8q5" Oct 29 23:29:25.399498 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:25.399462 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9"] Oct 29 23:29:25.399941 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:25.399653 6133 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerName="istio-proxy" containerID="cri-o://2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94" gracePeriod=30 Oct 29 23:29:25.627678 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:25.627644 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-597b95cb84-dbngb_21a75c65-a57a-480a-8f81-c9afebaa8753/cert-manager-controller/0.log" Oct 29 23:29:25.682983 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:25.682905 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-5c57bbd4fc-xnz4c_f0819649-64ee-45a9-bf40-162fae2a640e/cert-manager-cainjector/0.log" Oct 29 23:29:25.797700 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:25.797676 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-597b95cb84-dbngb_21a75c65-a57a-480a-8f81-c9afebaa8753/cert-manager-controller/0.log" Oct 29 23:29:25.854713 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:25.854688 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/cert-manager_cert-manager-cainjector-5c57bbd4fc-xnz4c_f0819649-64ee-45a9-bf40-162fae2a640e/cert-manager-cainjector/0.log" Oct 29 23:29:26.724839 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:26.724810 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsgvx_f9017cbf-6684-4052-a42c-d48f05c21961/dns/0.log" Oct 29 23:29:26.826698 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:26.826669 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsgvx_f9017cbf-6684-4052-a42c-d48f05c21961/kube-rbac-proxy/0.log" Oct 29 23:29:26.932241 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:26.932214 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4qzft_655998f3-b29e-47f0-9d86-04af9ff2d347/dns-node-resolver/0.log" Oct 29 23:29:26.993959 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:26.993904 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-rwgwb_a18c741f-f01f-41d5-8ec5-e941b91dc3f1/manager/0.log" Oct 29 23:29:27.048951 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:27.048918 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-rwgwb_a18c741f-f01f-41d5-8ec5-e941b91dc3f1/copy-manifests/0.log" Oct 29 23:29:27.067771 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:27.067747 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-rwgwb_a18c741f-f01f-41d5-8ec5-e941b91dc3f1/manager/0.log" Oct 29 23:29:27.120382 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:27.120354 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-rwgwb_a18c741f-f01f-41d5-8ec5-e941b91dc3f1/copy-manifests/0.log" Oct 29 23:29:27.934210 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:27.934173 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:28.046431 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.046405 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:28.060412 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.060387 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:28.146748 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.146720 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-tvn7p_175bcc70-e853-4ad6-8535-552ab49374fb/manager/0.log" Oct 29 23:29:28.224358 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.224294 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:28.256969 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.256948 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/0.log" Oct 29 23:29:28.257529 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.257510 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/1.log" Oct 29 23:29:28.350642 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.350615 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-mzd8f_18076c98-63e2-417c-ab52-65141215e258/manager/0.log" Oct 29 23:29:28.438566 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.438523 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:28.529613 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.529542 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-hd4dh_90ec1993-37cf-4d6f-902d-a2ca98b80cd0/server/0.log" Oct 29 23:29:28.607777 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.607749 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7pvl_3aa46c84-d4da-4894-83f5-bfe0bb886c42/node-ca/0.log" Oct 29 23:29:28.665042 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.665012 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:28.751013 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:28.750987 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-vdtbl_0a40e800-3874-4706-9ebb-ade608697967/manager/0.log" Oct 29 23:29:30.454323 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.454302 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:30.538931 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.538907 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:30.578152 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.578128 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:30.640828 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.640804 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:29:30.659242 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.659223 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:30.762143 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.762072 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/0.log" Oct 29 23:29:30.762819 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.762796 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/1.log" Oct 29 23:29:30.777195 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777167 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777322 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777228 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777395 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777347 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777455 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777416 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777481 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777516 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777509 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777629 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777538 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777629 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777542 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:30.777629 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777588 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 29 23:29:30.777785 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777723 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777785 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777743 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:30.777785 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777761 6133 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z\") pod \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\" (UID: \"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19\") " Oct 29 23:29:30.777962 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.777829 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:30.778204 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.778186 6133 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-data\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.778420 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.778402 6133 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-credential-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.778517 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.778425 6133 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istiod-ca-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.778517 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.778509 6133 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-socket\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.778628 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.778225 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:30.779899 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.779879 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 29 23:29:30.780067 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.780044 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:29:30.780244 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.780222 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 29 23:29:30.780602 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.780581 6133 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z" pod "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" (UID: "b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19"). InnerVolumeSpecName "kube-api-access-v7t5z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 29 23:29:30.838503 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.838480 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/0.log" Oct 29 23:29:30.839096 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.839079 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-j2mw9_b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/istio-proxy/1.log" Oct 29 23:29:30.879610 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.879589 6133 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-podinfo\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.879610 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.879610 6133 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-token\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.879724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.879619 6133 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-workload-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.879724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.879632 6133 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7t5z\" (UniqueName: \"kubernetes.io/projected/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-kube-api-access-v7t5z\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:30.879724 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:30.879645 6133 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19-istio-envoy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Oct 29 23:29:31.378085 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.378049 6133 generic.go:356] "Generic (PLEG): container finished" podID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" containerID="2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94" exitCode=0 Oct 29 23:29:31.378244 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.378118 6133 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" Oct 29 23:29:31.378244 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.378134 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" event={"ID":"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19","Type":"ContainerDied","Data":"2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94"} Oct 29 23:29:31.378244 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.378184 6133 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9" event={"ID":"b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19","Type":"ContainerDied","Data":"d7e15c47bfefd6bce25db2031741ef39a678fe1e4a713dc69eaf8c70d3ad5215"} Oct 29 23:29:31.378244 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.378209 6133 scope.go:122] "RemoveContainer" containerID="2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94" Oct 29 23:29:31.388454 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.388433 6133 scope.go:122] "RemoveContainer" containerID="275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc" Oct 29 23:29:31.396432 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.396414 6133 scope.go:122] "RemoveContainer" containerID="2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94" Oct 29 23:29:31.396696 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:29:31.396678 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94\": container with ID starting with 2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94 not found: ID does not exist" containerID="2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94" Oct 29 23:29:31.396774 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.396710 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94"} err="failed to get container status \"2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94\": rpc error: code = NotFound desc = could not find container \"2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94\": container with ID starting with 2b11d5cfaef1c7314ff35047cf3584642b96b762935227940a898a303f96aa94 not found: ID does not exist" Oct 29 23:29:31.396774 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.396734 6133 scope.go:122] "RemoveContainer" containerID="275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc" Oct 29 23:29:31.396988 ip-10-0-143-10 kubenswrapper[6133]: E1029 23:29:31.396970 6133 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc\": container with ID starting with 275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc not found: ID does not exist" containerID="275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc" Oct 29 23:29:31.397030 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.396995 6133 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc"} err="failed to get container status \"275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc\": rpc error: code = NotFound desc = could not find container \"275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc\": container with ID starting with 275aa7daa8caa559ebaa9a60ed511f93477861ed78a4df86022af4cd27ec03cc not found: ID does not exist" Oct 29 23:29:31.418121 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.418098 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:31.437248 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.437225 6133 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9"] Oct 29 23:29:31.442064 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.442046 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57dbfbcbdf-vwl7z_e63d4283-4f65-4b45-9130-187cc190f8e0/kube-auth-proxy/0.log" Oct 29 23:29:31.448328 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.448309 6133 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-j2mw9"] Oct 29 23:29:31.544220 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.544192 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:31.672278 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.672206 6133 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-4jwf8_fe40a474-984c-4ba2-bdce-0e90acd49bff/istio-proxy/0.log" Oct 29 23:29:31.956905 ip-10-0-143-10 kubenswrapper[6133]: I1029 23:29:31.956828 6133 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19" path="/var/lib/kubelet/pods/b27c1d5c-ee6e-4d18-b33f-f48e2f5f4a19/volumes"