Oct 30 22:07:04.710141 ip-10-0-139-44 systemd[1]: Starting Kubernetes Kubelet... Oct 30 22:07:05.060854 ip-10-0-139-44 kubenswrapper[2543]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:05.060854 ip-10-0-139-44 kubenswrapper[2543]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 22:07:05.060854 ip-10-0-139-44 kubenswrapper[2543]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:05.060854 ip-10-0-139-44 kubenswrapper[2543]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:05.066511 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066423 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.066511 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066511 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.066511 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066514 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066519 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066522 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066524 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066527 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066530 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066532 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066535 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066538 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066540 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066543 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066546 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066548 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066551 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066554 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066557 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066560 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066562 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066565 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066567 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.066605 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066570 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066579 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066582 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066585 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066587 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066590 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066592 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066595 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066597 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066600 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066602 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066606 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066608 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066612 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066614 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066618 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066621 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066623 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066626 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066628 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.067073 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066631 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066634 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066636 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066639 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066641 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066646 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066651 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066655 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066658 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066662 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066665 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066668 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066670 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066672 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066676 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066678 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066681 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066683 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066686 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.067532 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066689 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066691 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066694 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066697 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066700 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066702 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066705 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066707 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066710 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066713 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066715 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066718 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066720 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066723 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066726 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066728 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066731 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066733 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066736 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.067989 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066739 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066742 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066744 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066747 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066749 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066752 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066755 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066757 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066761 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066764 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066767 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066769 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066772 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066776 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066780 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066783 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066787 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066790 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066792 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.068430 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066795 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066797 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066799 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066802 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066805 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066807 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.066809 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067610 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067617 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067622 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067626 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067629 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067632 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067635 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067638 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067641 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067644 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067647 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067650 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067652 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.068887 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067655 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067658 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067661 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067663 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067666 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067669 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067671 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067674 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067676 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067679 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067682 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067685 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067687 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067690 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067692 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067694 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067697 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067700 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067702 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.069403 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067705 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067707 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067710 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067712 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067715 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067718 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067720 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067723 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067726 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067729 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067732 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067734 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067737 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067739 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067742 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067744 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067747 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067749 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067752 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067754 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.069893 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067757 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067760 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067762 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067765 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067767 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067770 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067772 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067775 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067777 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067782 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067785 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067787 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067790 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067792 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067795 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067797 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067800 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067803 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067805 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067807 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.070369 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067810 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067813 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067816 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067819 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067822 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067824 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067826 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067829 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067831 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067834 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067837 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067839 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067842 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067844 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067847 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067849 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067851 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067854 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067871 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.070854 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067874 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067877 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067881 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067884 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067886 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067889 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067891 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067894 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067897 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067899 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067902 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067926 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067931 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067934 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.067937 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068447 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068452 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068454 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068457 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.071316 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068460 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068462 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068465 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068468 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068470 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068473 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068475 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068478 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068481 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068483 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068486 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068488 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068491 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068493 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068496 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068500 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068502 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068505 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068507 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068510 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.071753 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068514 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068517 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068519 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068522 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068525 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068528 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068530 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068533 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068536 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068539 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068541 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068544 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068546 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068549 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068551 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068554 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068556 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068559 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068561 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068564 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.072230 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068567 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068569 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068572 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068575 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068578 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068581 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068583 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068586 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068589 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068591 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068594 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068596 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068598 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068601 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068603 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068606 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068609 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068611 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068614 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068616 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.072700 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068619 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068621 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068624 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068627 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068629 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068632 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068634 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068637 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068640 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068642 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068645 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068647 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068650 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068652 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068655 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068657 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068660 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068662 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068665 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068668 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.073177 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068670 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068673 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068678 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068680 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068683 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068685 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068688 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068690 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068693 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068696 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068698 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068702 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068706 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068709 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068715 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068719 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068722 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068725 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.073654 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068728 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068731 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068733 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.068736 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069405 2543 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069415 2543 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069422 2543 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069426 2543 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069431 2543 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069434 2543 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069438 2543 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069443 2543 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069446 2543 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069449 2543 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069453 2543 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069456 2543 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069461 2543 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069464 2543 flags.go:64] FLAG: --cgroup-root="" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069467 2543 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069470 2543 flags.go:64] FLAG: --client-ca-file="" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069473 2543 flags.go:64] FLAG: --cloud-provider="external" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069476 2543 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069481 2543 flags.go:64] FLAG: --cluster-domain="" Oct 30 22:07:05.074128 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069484 2543 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069487 2543 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069491 2543 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069494 2543 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069498 2543 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069501 2543 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069506 2543 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069509 2543 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069512 2543 flags.go:64] FLAG: --contention-profiling="false" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069515 2543 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069518 2543 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069521 2543 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069524 2543 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069529 2543 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069532 2543 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069535 2543 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069538 2543 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069541 2543 flags.go:64] FLAG: --enable-server="true" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069544 2543 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069548 2543 flags.go:64] FLAG: --event-burst="100" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069551 2543 flags.go:64] FLAG: --event-qps="50" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069554 2543 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069559 2543 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069562 2543 flags.go:64] FLAG: --eviction-hard="" Oct 30 22:07:05.075230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069566 2543 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069571 2543 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069574 2543 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069577 2543 flags.go:64] FLAG: --eviction-soft="" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069580 2543 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069583 2543 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069586 2543 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069589 2543 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069592 2543 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069595 2543 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069598 2543 flags.go:64] FLAG: --feature-gates="" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069602 2543 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069605 2543 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069608 2543 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069611 2543 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069615 2543 flags.go:64] FLAG: --healthz-port="10248" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069619 2543 flags.go:64] FLAG: --help="false" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069622 2543 flags.go:64] FLAG: --hostname-override="ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069625 2543 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069628 2543 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069631 2543 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069635 2543 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069638 2543 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069641 2543 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 22:07:05.075810 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069644 2543 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069647 2543 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069650 2543 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069653 2543 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069656 2543 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069659 2543 flags.go:64] FLAG: --kube-reserved="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069663 2543 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069666 2543 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069669 2543 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069673 2543 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069676 2543 flags.go:64] FLAG: --lock-file="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069679 2543 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069682 2543 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069685 2543 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069691 2543 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069694 2543 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069697 2543 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069699 2543 flags.go:64] FLAG: --logging-format="text" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069703 2543 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069706 2543 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069709 2543 flags.go:64] FLAG: --manifest-url="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069712 2543 flags.go:64] FLAG: --manifest-url-header="" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069716 2543 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069720 2543 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069724 2543 flags.go:64] FLAG: --max-pods="110" Oct 30 22:07:05.076469 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069727 2543 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069731 2543 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069734 2543 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069737 2543 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069740 2543 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069743 2543 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069746 2543 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069753 2543 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069756 2543 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069759 2543 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069762 2543 flags.go:64] FLAG: --pod-cidr="" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069765 2543 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069768 2543 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069773 2543 flags.go:64] FLAG: --pods-per-core="0" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069776 2543 flags.go:64] FLAG: --port="10250" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069779 2543 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069783 2543 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0086ab58e7fdbce1a" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069786 2543 flags.go:64] FLAG: --qos-reserved="" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069789 2543 flags.go:64] FLAG: --read-only-port="10255" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069793 2543 flags.go:64] FLAG: --register-node="true" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069796 2543 flags.go:64] FLAG: --register-with-taints="" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069799 2543 flags.go:64] FLAG: --registry-burst="10" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069802 2543 flags.go:64] FLAG: --registry-qps="5" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069805 2543 flags.go:64] FLAG: --reserved-cpus="" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069808 2543 flags.go:64] FLAG: --reserved-memory="" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069812 2543 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 22:07:05.077083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069815 2543 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069818 2543 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069821 2543 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069824 2543 flags.go:64] FLAG: --runonce="false" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069827 2543 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069830 2543 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069833 2543 flags.go:64] FLAG: --seccomp-default="false" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069836 2543 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069839 2543 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069842 2543 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069846 2543 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069849 2543 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069851 2543 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069854 2543 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069869 2543 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069872 2543 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069875 2543 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069878 2543 flags.go:64] FLAG: --system-cgroups="" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069881 2543 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069888 2543 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069891 2543 flags.go:64] FLAG: --tls-cert-file="" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069894 2543 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069900 2543 flags.go:64] FLAG: --tls-min-version="" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069903 2543 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069907 2543 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 22:07:05.077687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069910 2543 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069913 2543 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069916 2543 flags.go:64] FLAG: --v="2" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069920 2543 flags.go:64] FLAG: --version="false" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069925 2543 flags.go:64] FLAG: --vmodule="" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069929 2543 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.069932 2543 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070072 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070076 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070079 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070082 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070086 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070088 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070091 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070094 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070097 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070099 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070102 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070105 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070107 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070110 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.078325 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070113 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070115 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070118 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070121 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070123 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070127 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070130 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070133 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070136 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070138 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070141 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070144 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070146 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070149 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070151 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070154 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070157 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070159 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070162 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.078830 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070164 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070167 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070169 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070172 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070174 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070177 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070179 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070182 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070185 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070187 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070190 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070192 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070194 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070197 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070199 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070202 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070204 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070207 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070211 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.079296 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070214 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070217 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070219 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070224 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070227 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070230 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070232 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070235 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070238 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070241 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070243 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070246 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070248 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070251 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070254 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070256 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070259 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070261 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070264 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070266 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.079751 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070269 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070272 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070274 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070277 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070280 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070282 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070284 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070287 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070289 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070292 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070294 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070298 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070301 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070304 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070308 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070312 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070315 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070318 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070321 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070323 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.080239 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070326 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070329 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070331 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070334 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070336 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070339 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070342 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070344 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070347 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070349 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070352 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070354 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070357 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070359 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.070386 2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070419 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.080707 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070423 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070426 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070429 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070432 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070435 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070437 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070440 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070444 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070447 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070449 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070452 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070455 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070457 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070460 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070462 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070466 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070478 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070481 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070498 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070502 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.081106 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070505 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070508 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070511 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070513 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070516 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070519 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070521 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070524 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070526 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070531 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070533 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070537 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070540 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070543 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070545 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070548 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070551 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070553 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070556 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.081583 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070572 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070575 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070578 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070581 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070583 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070586 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070589 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070592 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070596 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070599 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070601 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070604 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070606 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070609 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070611 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070614 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070616 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070619 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070622 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070624 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.082057 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070627 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070629 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070634 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070636 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070639 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070642 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070644 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070647 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070650 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070652 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070655 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070658 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070661 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070664 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070667 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070669 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070672 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070674 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070678 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.082527 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070680 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070683 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070685 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070688 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070691 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070693 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070696 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070698 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070701 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070703 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070706 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070709 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070712 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070716 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070719 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070723 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070725 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070728 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070731 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.083043 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070734 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070737 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070739 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070743 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070745 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070748 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070753 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.070755 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.078030 2543 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.078049 2543 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.078064 2543 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.078068 2543 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078148 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078153 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078156 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078159 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078162 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078165 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078168 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078170 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.083525 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078173 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078176 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078178 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078181 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078184 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078187 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078189 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078193 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078195 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078198 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078201 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078203 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078212 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078216 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078221 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078224 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078227 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078230 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078232 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.084013 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078235 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078238 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078241 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078244 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078247 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078250 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078253 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078256 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078259 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078261 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078264 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078266 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078269 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078272 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078275 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078277 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078280 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078282 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078285 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078287 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.084445 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078290 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078292 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078295 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078298 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078300 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078303 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078312 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078315 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078318 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078320 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078323 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078326 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078329 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078331 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078335 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078338 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078340 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078343 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078346 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.084913 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078348 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078351 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078353 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078356 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078358 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078360 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078363 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078365 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078368 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078370 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078374 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078378 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078381 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078383 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078386 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078389 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078391 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078394 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078396 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.085351 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078399 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078407 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078410 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078413 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078415 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078418 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078421 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078423 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078426 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078429 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078431 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078434 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078436 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078439 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078442 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078445 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078447 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078450 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078452 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.085782 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078455 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078457 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.078492 2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078695 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078700 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078703 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078705 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078708 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078711 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078713 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078716 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078719 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078721 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078724 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078727 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.086250 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078735 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078738 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078740 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078743 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078745 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078748 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078751 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078754 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078756 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078759 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078761 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078764 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078766 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078769 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078771 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078773 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078776 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078779 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078781 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078784 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.086604 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078786 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078789 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078791 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078794 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078796 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078799 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078801 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078804 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078806 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078809 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078811 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078814 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078816 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078824 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078827 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078830 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078833 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078836 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078839 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.087139 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078841 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078844 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078847 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078849 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078852 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078854 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078870 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078873 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078876 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078879 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078881 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078884 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078886 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078889 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078891 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078894 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078897 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078899 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078902 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.087595 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078904 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078907 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078909 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078912 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078914 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078917 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078919 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078922 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078932 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078935 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078938 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078940 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078943 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078947 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078951 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078954 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078957 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078960 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078962 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078965 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.088151 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078967 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078970 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078972 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078975 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078977 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078985 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078988 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078991 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078994 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078996 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.078998 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079001 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079003 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079007 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079011 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079014 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.088755 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.079039 2543 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079082 2543 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079088 2543 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079092 2543 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079095 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079104 2543 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079107 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079110 2543 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079113 2543 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079115 2543 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079118 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079120 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079123 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079125 2543 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079128 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079130 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079133 2543 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079135 2543 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079138 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:05.089368 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079140 2543 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079143 2543 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079145 2543 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079148 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079154 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079156 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079159 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079161 2543 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079164 2543 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079166 2543 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079169 2543 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079171 2543 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079174 2543 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079176 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079180 2543 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079183 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079186 2543 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079188 2543 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079191 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079202 2543 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:05.090075 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079205 2543 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079207 2543 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079210 2543 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079213 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079215 2543 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079218 2543 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079220 2543 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079223 2543 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079226 2543 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079228 2543 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079231 2543 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079233 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079236 2543 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079238 2543 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079241 2543 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079256 2543 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079262 2543 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079267 2543 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079270 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:05.090843 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079272 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079275 2543 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079277 2543 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079280 2543 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079282 2543 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079285 2543 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079287 2543 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079293 2543 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079295 2543 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079298 2543 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079301 2543 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079304 2543 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079306 2543 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079316 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079319 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079322 2543 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079325 2543 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079327 2543 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079330 2543 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079332 2543 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:05.091381 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079335 2543 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079338 2543 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079340 2543 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079343 2543 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079345 2543 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079348 2543 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079350 2543 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079353 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079355 2543 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079359 2543 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079363 2543 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079367 2543 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079370 2543 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079372 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079375 2543 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079377 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079381 2543 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079383 2543 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079386 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:05.092007 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079390 2543 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079392 2543 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079395 2543 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079397 2543 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079400 2543 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079402 2543 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079405 2543 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079413 2543 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079416 2543 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:05.079419 2543 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.079476 2543 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.082432 2543 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.083289 2543 server.go:1014] "Starting client certificate rotation" Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.083388 2543 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.083428 2543 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.085432 2543 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:05.092639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.086872 2543 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:05.100452 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.100433 2543 log.go:25] "Validated CRI v1 runtime API" Oct 30 22:07:05.103696 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.103681 2543 log.go:25] "Validated CRI v1 image API" Oct 30 22:07:05.104488 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.104466 2543 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 22:07:05.106989 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.106970 2543 fs.go:135] Filesystem UUIDs: map[3f15da37-bd5f-4038-81bf-a6d5a94e78e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f634f008-7e61-4eb1-8379-f7a83752ebf6:/dev/nvme0n1p3] Oct 30 22:07:05.107058 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.106988 2543 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 22:07:05.112173 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.112068 2543 manager.go:217] Machine: {Timestamp:2026-10-30 22:07:05.110920637 +0000 UTC m=+0.298537441 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104243 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ded66cb3d058c32d6ddb68575571 SystemUUID:ec26ded6-6cb3-d058-c32d-6ddb68575571 BootID:0e29875a-6469-41c1-8716-8c5f99a65c78 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c1:2a:69:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c1:2a:69:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:de:1f:2b:00:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 22:07:05.112616 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.112606 2543 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 22:07:05.112698 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.112686 2543 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 22:07:05.115618 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.115594 2543 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 22:07:05.115749 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.115620 2543 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 22:07:05.116317 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.116307 2543 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 22:07:05.116346 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.116318 2543 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 22:07:05.116346 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.116332 2543 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:05.116346 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.116342 2543 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:05.117498 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.117488 2543 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 22:07:05.121796 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.121784 2543 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 22:07:05.121932 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.121922 2543 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 22:07:05.122646 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.122637 2543 kubelet.go:493] "Attempting to sync node with API server" Oct 30 22:07:05.122677 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.122651 2543 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 22:07:05.122677 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.122662 2543 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 22:07:05.122677 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.122670 2543 kubelet.go:405] "Adding apiserver pod source" Oct 30 22:07:05.122791 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.122678 2543 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 22:07:05.123043 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.123028 2543 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:05.125087 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.125068 2543 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 22:07:05.131402 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.131389 2543 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:05.132036 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132020 2543 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 22:07:05.132098 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132055 2543 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 22:07:05.132232 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132221 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 22:07:05.132270 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132236 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 22:07:05.132270 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132243 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 22:07:05.132270 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132249 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 22:07:05.132270 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132255 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 22:07:05.132270 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.132261 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 22:07:05.133037 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.133026 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 22:07:05.133066 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.133038 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 22:07:05.133066 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.133046 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 22:07:05.133066 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.133052 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 22:07:05.133066 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.133061 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 22:07:05.133181 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.133069 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 22:07:05.134361 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.134351 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 22:07:05.134361 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.134360 2543 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 22:07:05.138070 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.138057 2543 server.go:1263] "Started kubelet" Oct 30 22:07:05.138259 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.138211 2543 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 22:07:05.138337 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.138237 2543 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 22:07:05.138337 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.138319 2543 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 22:07:05.138776 ip-10-0-139-44 systemd[1]: Started Kubernetes Kubelet. Oct 30 22:07:05.142014 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.141474 2543 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 22:07:05.144511 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.144494 2543 server.go:317] "Adding debug handlers to kubelet server" Oct 30 22:07:05.147040 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.147021 2543 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 22:07:05.148912 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.148898 2543 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 22:07:05.149027 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.149002 2543 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:05.149150 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.149119 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.149580 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.149560 2543 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 22:07:05.149580 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.149581 2543 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 22:07:05.149699 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.149559 2543 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 22:07:05.149699 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.149674 2543 reconstruct.go:97] "Volume reconstruction finished" Oct 30 22:07:05.149699 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.149683 2543 reconciler.go:29] "Reconciler: start to sync state" Oct 30 22:07:05.150056 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150039 2543 factory.go:55] Registering systemd factory Oct 30 22:07:05.150154 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150059 2543 factory.go:223] Registration of the systemd container factory successfully Oct 30 22:07:05.150276 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150259 2543 factory.go:153] Registering CRI-O factory Oct 30 22:07:05.150327 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150282 2543 factory.go:223] Registration of the crio container factory successfully Oct 30 22:07:05.150374 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150338 2543 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 22:07:05.150374 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150357 2543 factory.go:103] Registering Raw factory Oct 30 22:07:05.150374 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.150372 2543 manager.go:1199] Started watching for new ooms in manager Oct 30 22:07:05.151239 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.151223 2543 manager.go:319] Starting recovery of all containers Oct 30 22:07:05.158498 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.158479 2543 manager.go:324] Recovery completed Oct 30 22:07:05.164044 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.164026 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.165963 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.165939 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.166049 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.165974 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.166049 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.165986 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.167242 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.166541 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.167242 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.166541 2543 cpu_manager.go:226] "Starting" policy="none" Oct 30 22:07:05.167242 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.166650 2543 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 22:07:05.167242 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.166668 2543 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 22:07:05.167242 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.167301 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.167644 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.167324 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.167644 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.167333 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.168855 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.168838 2543 policy_none.go:50] "Start" Oct 30 22:07:05.168950 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.168932 2543 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 22:07:05.168984 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.168948 2543 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 22:07:05.169522 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.169505 2543 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 22:07:05.169587 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.169517 2543 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 22:07:05.170369 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.169518 2543 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e00853d0118 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.13801244 +0000 UTC m=+0.325629241,LastTimestamp:2026-10-30 22:07:05.13801244 +0000 UTC m=+0.325629241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.185549 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.185507 2543 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 22:07:05.185549 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.185538 2543 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 22:07:05.185549 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.185443 2543 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e0086e7744c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-44.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.165960268 +0000 UTC m=+0.353577070,LastTimestamp:2026-10-30 22:07:05.165960268 +0000 UTC m=+0.353577070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.185737 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.185719 2543 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 22:07:05.185813 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.185765 2543 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tpr9l" Oct 30 22:07:05.192476 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.192455 2543 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tpr9l" Oct 30 22:07:05.206573 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.206544 2543 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Oct 30 22:07:05.206690 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.206593 2543 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e0086e7bce1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-44.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.165978849 +0000 UTC m=+0.353595714,LastTimestamp:2026-10-30 22:07:05.165978849 +0000 UTC m=+0.353595714,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.222248 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.222184 2543 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e0086e7ee5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-44.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.165991517 +0000 UTC m=+0.353608321,LastTimestamp:2026-10-30 22:07:05.165991517 +0000 UTC m=+0.353608321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.237413 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.237335 2543 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-44.ec2.internal.18e36e0086e7744c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e0086e7744c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-44.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.165960268 +0000 UTC m=+0.353577070,LastTimestamp:2026-10-30 22:07:05.167310993 +0000 UTC m=+0.354927795,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.250187 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.250168 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.265061 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.264993 2543 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-44.ec2.internal.18e36e0086e7bce1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e0086e7bce1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-44.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.165978849 +0000 UTC m=+0.353595714,LastTimestamp:2026-10-30 22:07:05.167328636 +0000 UTC m=+0.354945437,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.290856 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.290799 2543 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-44.ec2.internal.18e36e0086e7ee5d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e0086e7ee5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-44.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.165991517 +0000 UTC m=+0.353608321,LastTimestamp:2026-10-30 22:07:05.167336635 +0000 UTC m=+0.354953437,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.307129 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.307114 2543 policy_none.go:44] "Start" Oct 30 22:07:05.341635 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.341441 2543 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 22:07:05.346043 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346031 2543 manager.go:341] "Starting Device Plugin manager" Oct 30 22:07:05.346478 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.346454 2543 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 22:07:05.346478 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346477 2543 server.go:87] "Starting device plugin registration server" Oct 30 22:07:05.346711 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346694 2543 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 22:07:05.346798 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346706 2543 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 22:07:05.346888 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346822 2543 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 22:07:05.346943 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346929 2543 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 22:07:05.346943 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.346938 2543 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 22:07:05.347537 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.347517 2543 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 22:07:05.347614 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.347574 2543 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.371945 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.356639 2543 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-44.ec2.internal.18e36e009185743d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-44.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-44.ec2.internal,},FirstTimestamp:2026-10-30 22:07:05.344087101 +0000 UTC m=+0.531703894,LastTimestamp:2026-10-30 22:07:05.344087101 +0000 UTC m=+0.531703894,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-44.ec2.internal,}" Oct 30 22:07:05.395302 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.395271 2543 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 22:07:05.396484 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.396467 2543 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 22:07:05.397043 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.397025 2543 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 22:07:05.397131 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.397069 2543 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 22:07:05.397131 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.397113 2543 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 22:07:05.413158 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.413142 2543 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:05.420001 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.419986 2543 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-44.ec2.internal\" not found" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.447092 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.447075 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.447914 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.447900 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.447975 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.447927 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.447975 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.447939 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.447975 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.447969 2543 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.466367 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.466351 2543 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.466411 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.466370 2543 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-44.ec2.internal\": node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.497427 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.497401 2543 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal"] Oct 30 22:07:05.497513 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.497453 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.498268 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.498254 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.498323 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.498279 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.498323 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.498288 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.500388 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.500377 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.500525 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.500511 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.500568 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.500540 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.501104 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.501089 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.501160 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.501109 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.501160 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.501118 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.501160 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.501128 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.501160 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.501131 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.501160 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.501142 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.503200 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.503188 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.503244 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.503211 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:05.503929 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.503915 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:05.504024 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.503941 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:05.504024 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.503959 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:05.507393 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.507375 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.537455 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.537432 2543 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-44.ec2.internal\" not found" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.544057 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.544042 2543 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-44.ec2.internal\" not found" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.551726 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.551708 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c871cf99dd9dbde7be3b85cc0f154c8c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" (UID: \"c871cf99dd9dbde7be3b85cc0f154c8c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.551776 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.551734 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.551776 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.551752 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.608448 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.608412 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.652558 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.652539 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c871cf99dd9dbde7be3b85cc0f154c8c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" (UID: \"c871cf99dd9dbde7be3b85cc0f154c8c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.652626 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.652571 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.652626 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.652592 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.652693 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.652637 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.652693 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.652644 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c871cf99dd9dbde7be3b85cc0f154c8c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" (UID: \"c871cf99dd9dbde7be3b85cc0f154c8c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.652693 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.652652 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.709424 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.709404 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.810370 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.810334 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:05.841536 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.841512 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.848502 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:05.848486 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:05.911090 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:05.911021 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.011486 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.011458 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.083015 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.082973 2543 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 22:07:06.083455 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.083140 2543 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 22:07:06.112283 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.112256 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.212645 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.212587 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.305189 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.305159 2543 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:06.308408 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.308358 2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 22:02:06 +0000 UTC" deadline="2028-05-22 01:51:09.722301223 +0000 UTC" Oct 30 22:07:06.308408 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.308397 2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13659h44m3.413907511s" Oct 30 22:07:06.309588 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.309566 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:06.309711 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.309600 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:06.309711 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.309610 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:06.312693 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.312673 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.404656 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:06.404608 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc871cf99dd9dbde7be3b85cc0f154c8c.slice/crio-c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77 WatchSource:0}: Error finding container c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77: Status 404 returned error can't find the container with id c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77 Oct 30 22:07:06.404973 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:06.404940 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e73e1006f70395d6db6b83f01253f3d.slice/crio-38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9 WatchSource:0}: Error finding container 38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9: Status 404 returned error can't find the container with id 38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9 Oct 30 22:07:06.411244 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.411229 2543 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:07:06.412801 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.412780 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.441587 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.441566 2543 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:06.513275 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.513211 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.615504 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.615471 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.718503 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:06.718450 2543 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:06.774589 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.774500 2543 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:06.815704 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.815678 2543 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:06.850025 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.849998 2543 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:06.875024 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.874999 2543 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:06.876144 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.876123 2543 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:06.901649 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:06.901624 2543 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:07.124281 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.124198 2543 apiserver.go:52] "Watching apiserver" Oct 30 22:07:07.150314 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.150282 2543 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:07.157129 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.157103 2543 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 22:07:07.157515 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.157483 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-hv7wm","openshift-network-operator/iptables-alerter-ktczf","kube-system/konnectivity-agent-jxn8m","kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal","openshift-multus/multus-cqvt9","openshift-ovn-kubernetes/ovnkube-node-v9p8m","kube-system/global-pull-secret-syncer-dfsk2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4","openshift-cluster-node-tuning-operator/tuned-hkdv6","openshift-dns/node-resolver-kjm85","openshift-multus/multus-additional-cni-plugins-bh6l9","openshift-image-registry/node-ca-nm8gp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal","openshift-multus/network-metrics-daemon-ts8xm"] Oct 30 22:07:07.160270 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.160247 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.162670 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.162650 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.164999 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.164974 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.167251 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.167229 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.167349 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.167305 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:07.169857 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.169836 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.173468 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.172409 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.174665 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.174644 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.177430 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.177405 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.178827 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.178803 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.178908 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.178829 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vdq5j\"" Oct 30 22:07:07.179563 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.179544 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.182014 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.180851 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.187366 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.185246 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.187366 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.185347 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 22:07:07.187366 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.185481 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgfdn\"" Oct 30 22:07:07.187366 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.185564 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.187366 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.185644 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 22:07:07.190918 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.190896 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:07.191032 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.190954 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:07.193568 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.193550 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.193667 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.193604 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:07.196070 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.196049 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.206544 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.206519 2543 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 22:07:07.206651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.206600 2543 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxn5j" Oct 30 22:07:07.210974 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.210953 2543 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dxn5j" Oct 30 22:07:07.250795 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.250771 2543 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261456 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-k8s-cni-cncf-io\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261500 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-netns\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261531 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-systemd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261555 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261583 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-env-overrides\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261611 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwvlx\" (UniqueName: \"kubernetes.io/projected/94271ee8-5df1-4578-af2f-97bba140bd50-kube-api-access-fwvlx\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261636 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-lib-modules\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261662 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kthqb\" (UniqueName: \"kubernetes.io/projected/11d96b43-b437-4dbf-92fb-7d21a7fc8060-kube-api-access-kthqb\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261690 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cni-binary-copy\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261714 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-multus-certs\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261739 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-log-socket\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261770 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-run\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261800 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-kubelet-config\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261825 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261850 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-kubelet\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.265405 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261875 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxq44\" (UniqueName: \"kubernetes.io/projected/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-kube-api-access-xxq44\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261898 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-node-log\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261953 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-netd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.261981 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262006 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-conf\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262040 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262071 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-var-lib-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262094 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-tmp\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262121 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262169 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-systemd-units\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262202 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-bin\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262229 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-registration-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262254 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262278 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b612bcc-424f-40f3-ac06-7403ac235f75-host-slash\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262305 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-kubernetes\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262327 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-sys\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266288 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262356 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262381 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-etc-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262416 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262447 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c717de0c-8143-4d25-926b-5f948a9d7903-agent-certs\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262471 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-modprobe-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262496 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd0c97-042f-4a9b-b685-e40d3480ae12-hosts-file\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262522 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-device-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262549 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-hostroot\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262575 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-daemon-config\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262600 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-host\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262627 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262691 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-system-cni-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262745 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cnibin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262772 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262797 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262823 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-system-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.266954 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262849 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-multus\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262874 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-slash\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262900 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-var-lib-kubelet\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262947 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-dbus\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.262976 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263284 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263325 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-netns\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263370 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263402 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-script-lib\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263431 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-sys-fs\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263487 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30416ea7-1ca2-4983-8de2-5e881a3a9717-host\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263510 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-systemd\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263537 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysconfig\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263557 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zndl\" (UniqueName: \"kubernetes.io/projected/13bd0c97-042f-4a9b-b685-e40d3480ae12-kube-api-access-9zndl\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263588 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-conf-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263609 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.267550 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263638 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cnibin\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263668 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-socket-dir-parent\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263685 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72lvd\" (UniqueName: \"kubernetes.io/projected/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-kube-api-access-72lvd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263702 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30416ea7-1ca2-4983-8de2-5e881a3a9717-serviceca\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263744 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wggrj\" (UniqueName: \"kubernetes.io/projected/30416ea7-1ca2-4983-8de2-5e881a3a9717-kube-api-access-wggrj\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263774 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c717de0c-8143-4d25-926b-5f948a9d7903-konnectivity-ca\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263804 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-config\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263834 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b612bcc-424f-40f3-ac06-7403ac235f75-iptables-alerter-script\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263927 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-tuned\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.263974 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd0c97-042f-4a9b-b685-e40d3480ae12-tmp-dir\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264002 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-kubelet\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264030 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljd8n\" (UniqueName: \"kubernetes.io/projected/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-kube-api-access-ljd8n\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264064 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-bin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264093 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-etc-kubernetes\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264119 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-socket-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264145 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-ovn\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.268185 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264174 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9f4z\" (UniqueName: \"kubernetes.io/projected/5b612bcc-424f-40f3-ac06-7403ac235f75-kube-api-access-s9f4z\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.269060 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.264203 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqxjt\" (UniqueName: \"kubernetes.io/projected/8bf06513-3f43-4d61-9169-1cf2b37a0c64-kube-api-access-xqxjt\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.287822 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.287796 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 22:07:07.288014 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.287972 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.288151 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288133 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.288231 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288210 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 22:07:07.288298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288229 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 22:07:07.288298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288245 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-7l7rd\"" Oct 30 22:07:07.288298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288243 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 22:07:07.288298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288282 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-22mqf\"" Oct 30 22:07:07.288298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288289 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 22:07:07.288497 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288322 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 22:07:07.288497 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288329 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.288497 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288328 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288502 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288514 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288569 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288579 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9t4n\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288515 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288582 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dzfp9\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288517 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288589 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjfxj\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288616 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 22:07:07.288651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288645 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.289142 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288719 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4nws\"" Oct 30 22:07:07.289142 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288784 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:07.289142 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.288939 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 22:07:07.289142 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.289070 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 22:07:07.289438 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.289412 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfzqs\"" Oct 30 22:07:07.289535 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.289523 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 22:07:07.347814 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.347788 2543 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364338 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-run\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364365 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-kubelet-config\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364502 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364530 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-kubelet\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364560 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxq44\" (UniqueName: \"kubernetes.io/projected/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-kube-api-access-xxq44\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364556 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-run\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364580 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-kubelet-config\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364588 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-node-log\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364632 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-node-log\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364645 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-netd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364694 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364719 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-conf\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364703 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-kubelet\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364739 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.364722 2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364752 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-netd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364764 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-var-lib-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.365186 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364788 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-tmp\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364822 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.364862 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret podName:fae7117e-4b5b-4698-8369-825a1583d108 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:07.864830127 +0000 UTC m=+3.052446933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret") pod "global-pull-secret-syncer-dfsk2" (UID: "fae7117e-4b5b-4698-8369-825a1583d108") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364969 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-var-lib-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364910 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-conf\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364995 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-systemd-units\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365067 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.364970 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-systemd-units\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365119 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365120 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-bin\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365146 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-bin\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365178 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-registration-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365211 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365238 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b612bcc-424f-40f3-ac06-7403ac235f75-host-slash\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365278 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-registration-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365265 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-kubernetes\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.366271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365330 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-sys\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365359 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365386 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-etc-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365417 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365424 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365445 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c717de0c-8143-4d25-926b-5f948a9d7903-agent-certs\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365455 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365471 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-modprobe-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365472 2543 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365510 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd0c97-042f-4a9b-b685-e40d3480ae12-hosts-file\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365524 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-sys\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365541 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-device-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365583 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-hostroot\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365587 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-modprobe-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365391 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-kubernetes\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.365607 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.365657 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:07.865639889 +0000 UTC m=+3.053256679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:07.367083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365655 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365608 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-daemon-config\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365696 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-host\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365717 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365735 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-system-cni-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365754 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cnibin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365779 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365825 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd0c97-042f-4a9b-b685-e40d3480ae12-hosts-file\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365833 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365865 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365879 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-host\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365896 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-system-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365925 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-system-cni-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365952 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-multus\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365982 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-slash\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365999 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cnibin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366009 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-var-lib-kubelet\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366031 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-dbus\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.367894 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366053 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-hostroot\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366057 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366086 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b612bcc-424f-40f3-ac06-7403ac235f75-host-slash\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366110 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365895 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-device-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366160 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.365499 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-etc-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366251 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-netns\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366276 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366282 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-system-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366274 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-daemon-config\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366315 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-netns\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366337 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-script-lib\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366369 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-sys-fs\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366416 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30416ea7-1ca2-4983-8de2-5e881a3a9717-host\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366317 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-dbus\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366501 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-systemd\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.368789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366537 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysconfig\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366565 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zndl\" (UniqueName: \"kubernetes.io/projected/13bd0c97-042f-4a9b-b685-e40d3480ae12-kube-api-access-9zndl\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366591 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-conf-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366619 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366641 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cnibin\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366636 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366696 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-conf-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366710 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366726 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366730 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cnibin\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366739 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-socket-dir-parent\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366762 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-slash\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366769 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-systemd\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366772 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-var-lib-kubelet\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366786 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lvd\" (UniqueName: \"kubernetes.io/projected/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-kube-api-access-72lvd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366797 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-multus\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366809 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30416ea7-1ca2-4983-8de2-5e881a3a9717-serviceca\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.369671 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366860 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggrj\" (UniqueName: \"kubernetes.io/projected/30416ea7-1ca2-4983-8de2-5e881a3a9717-kube-api-access-wggrj\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366884 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c717de0c-8143-4d25-926b-5f948a9d7903-konnectivity-ca\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366908 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-config\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.366987 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b612bcc-424f-40f3-ac06-7403ac235f75-iptables-alerter-script\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367000 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30416ea7-1ca2-4983-8de2-5e881a3a9717-host\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367015 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-tuned\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367038 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd0c97-042f-4a9b-b685-e40d3480ae12-tmp-dir\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367069 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-kubelet\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367156 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljd8n\" (UniqueName: \"kubernetes.io/projected/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-kube-api-access-ljd8n\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367180 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-bin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367201 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-etc-kubernetes\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367223 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-socket-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367248 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-ovn\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367273 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9f4z\" (UniqueName: \"kubernetes.io/projected/5b612bcc-424f-40f3-ac06-7403ac235f75-kube-api-access-s9f4z\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367296 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqxjt\" (UniqueName: \"kubernetes.io/projected/8bf06513-3f43-4d61-9169-1cf2b37a0c64-kube-api-access-xqxjt\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367294 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-sys-fs\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367377 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-script-lib\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.370492 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367420 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-socket-dir-parent\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367442 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysconfig\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367519 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30416ea7-1ca2-4983-8de2-5e881a3a9717-serviceca\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367684 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-kubelet\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367693 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-k8s-cni-cncf-io\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367688 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-socket-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367741 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-netns\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367753 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-k8s-cni-cncf-io\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367773 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-systemd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367805 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367809 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-ovn\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.367834 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-env-overrides\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368019 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-config\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368071 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvlx\" (UniqueName: \"kubernetes.io/projected/94271ee8-5df1-4578-af2f-97bba140bd50-kube-api-access-fwvlx\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368118 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-lib-modules\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368146 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kthqb\" (UniqueName: \"kubernetes.io/projected/11d96b43-b437-4dbf-92fb-7d21a7fc8060-kube-api-access-kthqb\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368219 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cni-binary-copy\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368238 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd0c97-042f-4a9b-b685-e40d3480ae12-tmp-dir\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.371094 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368249 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-multus-certs\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.371955 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.368289 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-log-socket\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.372655 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-env-overrides\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.372757 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c717de0c-8143-4d25-926b-5f948a9d7903-konnectivity-ca\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.372755 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-tmp\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.372967 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b612bcc-424f-40f3-ac06-7403ac235f75-iptables-alerter-script\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373006 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-log-socket\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373067 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-bin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373068 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373118 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-etc-kubernetes\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373140 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373137 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c717de0c-8143-4d25-926b-5f948a9d7903-agent-certs\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373170 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-systemd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373182 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-netns\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373246 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-multus-certs\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373372 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-lib-modules\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373438 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-tuned\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.375647 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.373552 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cni-binary-copy\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.390689 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.390666 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:07.390689 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.390688 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:07.390862 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.390700 2543 projected.go:196] Error preparing data for projected volume kube-api-access-lpnnz for pod openshift-network-diagnostics/network-check-target-hv7wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:07.390862 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.390768 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz podName:9ac149ae-bb65-4902-aa71-941f3ac65a8a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:07.890752213 +0000 UTC m=+3.078369027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lpnnz" (UniqueName: "kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz") pod "network-check-target-hv7wm" (UID: "9ac149ae-bb65-4902-aa71-941f3ac65a8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:07.391400 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.391373 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxq44\" (UniqueName: \"kubernetes.io/projected/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-kube-api-access-xxq44\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.393691 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.393327 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lvd\" (UniqueName: \"kubernetes.io/projected/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-kube-api-access-72lvd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.393691 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.393645 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zndl\" (UniqueName: \"kubernetes.io/projected/13bd0c97-042f-4a9b-b685-e40d3480ae12-kube-api-access-9zndl\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.394769 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.394741 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wggrj\" (UniqueName: \"kubernetes.io/projected/30416ea7-1ca2-4983-8de2-5e881a3a9717-kube-api-access-wggrj\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.394944 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.394923 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqxjt\" (UniqueName: \"kubernetes.io/projected/8bf06513-3f43-4d61-9169-1cf2b37a0c64-kube-api-access-xqxjt\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.395231 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.395207 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9f4z\" (UniqueName: \"kubernetes.io/projected/5b612bcc-424f-40f3-ac06-7403ac235f75-kube-api-access-s9f4z\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.396542 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.396522 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljd8n\" (UniqueName: \"kubernetes.io/projected/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-kube-api-access-ljd8n\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.399977 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.399933 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvlx\" (UniqueName: \"kubernetes.io/projected/94271ee8-5df1-4578-af2f-97bba140bd50-kube-api-access-fwvlx\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.402139 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.400673 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kthqb\" (UniqueName: \"kubernetes.io/projected/11d96b43-b437-4dbf-92fb-7d21a7fc8060-kube-api-access-kthqb\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.403546 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.403498 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" event={"ID":"c871cf99dd9dbde7be3b85cc0f154c8c","Type":"ContainerStarted","Data":"c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77"} Oct 30 22:07:07.405586 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.405559 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" event={"ID":"8e73e1006f70395d6db6b83f01253f3d","Type":"ContainerStarted","Data":"38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9"} Oct 30 22:07:07.475844 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.475815 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:07.487863 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.487834 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bd0c97_042f_4a9b_b685_e40d3480ae12.slice/crio-444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497 WatchSource:0}: Error finding container 444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497: Status 404 returned error can't find the container with id 444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497 Oct 30 22:07:07.499687 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.499660 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:07.504027 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.503846 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:07.506600 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.506575 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqvt9" Oct 30 22:07:07.510251 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.510226 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d96b43_b437_4dbf_92fb_7d21a7fc8060.slice/crio-2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f WatchSource:0}: Error finding container 2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f: Status 404 returned error can't find the container with id 2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f Oct 30 22:07:07.517018 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.516991 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc717de0c_8143_4d25_926b_5f948a9d7903.slice/crio-0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753 WatchSource:0}: Error finding container 0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753: Status 404 returned error can't find the container with id 0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753 Oct 30 22:07:07.517943 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.517915 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b412a6_23fb_4c4a_91a6_bd60a71a668c.slice/crio-3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95 WatchSource:0}: Error finding container 3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95: Status 404 returned error can't find the container with id 3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95 Oct 30 22:07:07.529981 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.529953 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:07.533756 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.533730 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:07.540822 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.540799 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:07.541715 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.541687 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf06513_3f43_4d61_9169_1cf2b37a0c64.slice/crio-4d0fa7f6015719c849c2415ebb11b101ec9baa69ecb5a48607a709185c0f2ebb WatchSource:0}: Error finding container 4d0fa7f6015719c849c2415ebb11b101ec9baa69ecb5a48607a709185c0f2ebb: Status 404 returned error can't find the container with id 4d0fa7f6015719c849c2415ebb11b101ec9baa69ecb5a48607a709185c0f2ebb Oct 30 22:07:07.543534 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.543517 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:07.550706 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.550658 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:07.556741 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.556714 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b612bcc_424f_40f3_ac06_7403ac235f75.slice/crio-15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe WatchSource:0}: Error finding container 15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe: Status 404 returned error can't find the container with id 15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe Oct 30 22:07:07.563929 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:07.563897 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30416ea7_1ca2_4983_8de2_5e881a3a9717.slice/crio-cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c WatchSource:0}: Error finding container cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c: Status 404 returned error can't find the container with id cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c Oct 30 22:07:07.876983 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.876947 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:07.877174 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.877016 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:07.877174 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.877162 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:07.877278 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.877218 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:08.877203544 +0000 UTC m=+4.064820356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:07.877278 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.877158 2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:07.877369 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.877323 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret podName:fae7117e-4b5b-4698-8369-825a1583d108 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:08.877292269 +0000 UTC m=+4.064909072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret") pod "global-pull-secret-syncer-dfsk2" (UID: "fae7117e-4b5b-4698-8369-825a1583d108") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:07.978789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:07.978162 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:07.978789 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.978330 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:07.978789 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.978364 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:07.978789 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.978378 2543 projected.go:196] Error preparing data for projected volume kube-api-access-lpnnz for pod openshift-network-diagnostics/network-check-target-hv7wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:07.978789 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:07.978441 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz podName:9ac149ae-bb65-4902-aa71-941f3ac65a8a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:08.978421648 +0000 UTC m=+4.166038446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpnnz" (UniqueName: "kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz") pod "network-check-target-hv7wm" (UID: "9ac149ae-bb65-4902-aa71-941f3ac65a8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:08.214200 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.213804 2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:08 +0000 UTC" deadline="2028-05-25 15:51:26.174517128 +0000 UTC" Oct 30 22:07:08.214200 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.214118 2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13745h44m17.960406533s" Oct 30 22:07:08.405987 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.405284 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:08.405987 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.405420 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:08.413892 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.413857 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" event={"ID":"c871cf99dd9dbde7be3b85cc0f154c8c","Type":"ContainerStarted","Data":"177c13c689b9566367988756c2841184c55ab600af7e6d5cad72c35275bda7fb"} Oct 30 22:07:08.427240 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.427202 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nm8gp" event={"ID":"30416ea7-1ca2-4983-8de2-5e881a3a9717","Type":"ContainerStarted","Data":"cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c"} Oct 30 22:07:08.432680 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.432648 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqvt9" event={"ID":"e9b412a6-23fb-4c4a-91a6-bd60a71a668c","Type":"ContainerStarted","Data":"3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95"} Oct 30 22:07:08.441816 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.441731 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerStarted","Data":"2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f"} Oct 30 22:07:08.447377 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.447291 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kjm85" event={"ID":"13bd0c97-042f-4a9b-b685-e40d3480ae12","Type":"ContainerStarted","Data":"444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497"} Oct 30 22:07:08.452097 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.452031 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktczf" event={"ID":"5b612bcc-424f-40f3-ac06-7403ac235f75","Type":"ContainerStarted","Data":"15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe"} Oct 30 22:07:08.460336 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.460244 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" event={"ID":"94271ee8-5df1-4578-af2f-97bba140bd50","Type":"ContainerStarted","Data":"78230a4adb6cf240329f2bc2ec4146d0a0343f4ceb30cc9eeb71c48ac3addb98"} Oct 30 22:07:08.465845 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.465772 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"79acd85702d56239d4e56da120f94cf9d7c724944633dd9ed4f1ecf09b18e505"} Oct 30 22:07:08.473972 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.472967 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" event={"ID":"8bf06513-3f43-4d61-9169-1cf2b37a0c64","Type":"ContainerStarted","Data":"4d0fa7f6015719c849c2415ebb11b101ec9baa69ecb5a48607a709185c0f2ebb"} Oct 30 22:07:08.475626 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.475601 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jxn8m" event={"ID":"c717de0c-8143-4d25-926b-5f948a9d7903","Type":"ContainerStarted","Data":"0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753"} Oct 30 22:07:08.893184 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.893101 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:08.893184 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.893160 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:08.893415 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.893253 2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:08.893415 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.893306 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:08.893415 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.893327 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret podName:fae7117e-4b5b-4698-8369-825a1583d108 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:10.893306099 +0000 UTC m=+6.080922906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret") pod "global-pull-secret-syncer-dfsk2" (UID: "fae7117e-4b5b-4698-8369-825a1583d108") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:08.893415 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.893358 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:10.893340675 +0000 UTC m=+6.080957486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:08.994592 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:08.993902 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:08.994592 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.994116 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:08.994592 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.994150 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:08.994592 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.994164 2543 projected.go:196] Error preparing data for projected volume kube-api-access-lpnnz for pod openshift-network-diagnostics/network-check-target-hv7wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:08.994592 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:08.994220 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz podName:9ac149ae-bb65-4902-aa71-941f3ac65a8a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:10.994201477 +0000 UTC m=+6.181818271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpnnz" (UniqueName: "kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz") pod "network-check-target-hv7wm" (UID: "9ac149ae-bb65-4902-aa71-941f3ac65a8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:09.215084 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.214964 2543 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:08 +0000 UTC" deadline="2028-08-02 00:56:50.429902702 +0000 UTC" Oct 30 22:07:09.215084 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.215011 2543 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15386h49m41.214896393s" Oct 30 22:07:09.400197 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.398005 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:09.400197 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:09.398142 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:09.400197 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.398669 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:09.400197 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:09.398785 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:09.502566 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.501899 2543 generic.go:356] "Generic (PLEG): container finished" podID="8e73e1006f70395d6db6b83f01253f3d" containerID="d802c259275b4d5c376cf05f1b155d1fb58e50ea35af66779611deaf15e949dd" exitCode=0 Oct 30 22:07:09.502566 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.502009 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" event={"ID":"8e73e1006f70395d6db6b83f01253f3d","Type":"ContainerDied","Data":"d802c259275b4d5c376cf05f1b155d1fb58e50ea35af66779611deaf15e949dd"} Oct 30 22:07:09.547271 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:09.547197 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" podStartSLOduration=2.547176679 podStartE2EDuration="2.547176679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:08.464110282 +0000 UTC m=+3.651727097" watchObservedRunningTime="2026-10-30 22:07:09.547176679 +0000 UTC m=+4.734793494" Oct 30 22:07:10.397953 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:10.397914 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:10.398397 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:10.398068 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:10.522064 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:10.521995 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" event={"ID":"8e73e1006f70395d6db6b83f01253f3d","Type":"ContainerStarted","Data":"4c4f72b13cf6d58bcf9d5e11a40623636706b831c79cdf613166596c677d84c5"} Oct 30 22:07:10.911176 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:10.911131 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:10.911342 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:10.911192 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:10.911405 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:10.911376 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:10.911551 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:10.911534 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:14.911513187 +0000 UTC m=+10.099129993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:10.912013 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:10.911992 2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:10.912083 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:10.912054 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret podName:fae7117e-4b5b-4698-8369-825a1583d108 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:14.912037991 +0000 UTC m=+10.099654789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret") pod "global-pull-secret-syncer-dfsk2" (UID: "fae7117e-4b5b-4698-8369-825a1583d108") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:11.012838 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:11.012118 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:11.012838 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:11.012347 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:11.012838 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:11.012373 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:11.012838 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:11.012387 2543 projected.go:196] Error preparing data for projected volume kube-api-access-lpnnz for pod openshift-network-diagnostics/network-check-target-hv7wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:11.012838 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:11.012446 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz podName:9ac149ae-bb65-4902-aa71-941f3ac65a8a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:15.012428346 +0000 UTC m=+10.200045144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpnnz" (UniqueName: "kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz") pod "network-check-target-hv7wm" (UID: "9ac149ae-bb65-4902-aa71-941f3ac65a8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:11.402053 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:11.401940 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:11.402053 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:11.401966 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:11.402597 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:11.402092 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:11.402597 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:11.402549 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:11.531434 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:11.531397 2543 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="61af6b53c8ec9afb6ec351647499a56740b944bf111810d68a3c566eb477206d" exitCode=0 Oct 30 22:07:11.532054 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:11.531996 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerDied","Data":"61af6b53c8ec9afb6ec351647499a56740b944bf111810d68a3c566eb477206d"} Oct 30 22:07:11.614505 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:11.614439 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" podStartSLOduration=4.61441792 podStartE2EDuration="4.61441792s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:10.569730687 +0000 UTC m=+5.757347502" watchObservedRunningTime="2026-10-30 22:07:11.61441792 +0000 UTC m=+6.802034736" Oct 30 22:07:12.398263 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:12.398223 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:12.398456 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:12.398390 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:12.536781 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:12.536734 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jxn8m" event={"ID":"c717de0c-8143-4d25-926b-5f948a9d7903","Type":"ContainerStarted","Data":"d3dbebc1ce40b02ccab5dce5b5e26bde31ac62d626486e7b910fd6c6107dca2d"} Oct 30 22:07:12.588791 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:12.588675 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jxn8m" podStartSLOduration=2.657524834 podStartE2EDuration="6.588654761s" totalImagesPullingTime="3.931129927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:12.588162066 +0000 UTC m=+7.775778884" watchObservedRunningTime="2026-10-30 22:07:12.588654761 +0000 UTC m=+7.776271579" Oct 30 22:07:13.398247 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:13.398212 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:13.398406 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:13.398375 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:13.401433 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:13.398775 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:13.401433 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:13.398882 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:13.545625 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:13.545567 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nm8gp" event={"ID":"30416ea7-1ca2-4983-8de2-5e881a3a9717","Type":"ContainerStarted","Data":"d2bbbfd5b42cd7ee9773554a643d6cd21ea87234b6a949d01e9d6d8b9bacb2d6"} Oct 30 22:07:14.397585 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:14.397496 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:14.397756 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:14.397644 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:14.563231 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:14.563016 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" event={"ID":"94271ee8-5df1-4578-af2f-97bba140bd50","Type":"ContainerStarted","Data":"6e478dced515e47b37e57e6970b185306b2233801c7d24126816073f7b338bf6"} Oct 30 22:07:14.945933 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:14.945877 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:14.946096 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:14.945960 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:14.946153 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:14.946122 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:14.946204 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:14.946188 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:22.94616622 +0000 UTC m=+18.133783026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:14.946646 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:14.946622 2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:14.946757 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:14.946682 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret podName:fae7117e-4b5b-4698-8369-825a1583d108 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:22.946667473 +0000 UTC m=+18.134284284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret") pod "global-pull-secret-syncer-dfsk2" (UID: "fae7117e-4b5b-4698-8369-825a1583d108") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:15.046804 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.046767 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:15.046942 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:15.046907 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:15.046942 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:15.046922 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:15.046942 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:15.046932 2543 projected.go:196] Error preparing data for projected volume kube-api-access-lpnnz for pod openshift-network-diagnostics/network-check-target-hv7wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:15.047109 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:15.046982 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz podName:9ac149ae-bb65-4902-aa71-941f3ac65a8a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:23.046967892 +0000 UTC m=+18.234584688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpnnz" (UniqueName: "kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz") pod "network-check-target-hv7wm" (UID: "9ac149ae-bb65-4902-aa71-941f3ac65a8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:15.053886 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.053833 2543 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 22:07:15.353586 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.352828 2543 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T22:07:15.053853503Z","UUID":"42f994e8-77a3-4216-8c91-b307094d9219","Handler":null,"Name":"","Endpoint":""} Oct 30 22:07:15.355083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.354604 2543 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 22:07:15.355083 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.354634 2543 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 22:07:15.403670 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.402881 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:15.403670 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:15.403110 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:15.403670 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.403497 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:15.403670 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:15.403613 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:15.569298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.568449 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqvt9" event={"ID":"e9b412a6-23fb-4c4a-91a6-bd60a71a668c","Type":"ContainerStarted","Data":"b0541992d27b76e9491c56cbe92f738ddd815aa3a9e3c16ef264c42270f0d5bb"} Oct 30 22:07:15.588113 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.588036 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" event={"ID":"94271ee8-5df1-4578-af2f-97bba140bd50","Type":"ContainerStarted","Data":"2b6fa91a8fd3b64abc21f6f1ce7843317fde90b54456094ba66b674b0ac40c96"} Oct 30 22:07:15.618353 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.617434 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cqvt9" podStartSLOduration=1.6843281490000002 podStartE2EDuration="9.617415063s" totalImagesPullingTime="7.933086914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:15.617289362 +0000 UTC m=+10.804906175" watchObservedRunningTime="2026-10-30 22:07:15.617415063 +0000 UTC m=+10.805031881" Oct 30 22:07:15.618353 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:15.618001 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nm8gp" podStartSLOduration=4.230935331 podStartE2EDuration="9.617991848s" totalImagesPullingTime="5.387056517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:13.592244652 +0000 UTC m=+8.779861463" watchObservedRunningTime="2026-10-30 22:07:15.617991848 +0000 UTC m=+10.805608664" Oct 30 22:07:16.354149 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.353897 2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:16.354349 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.354328 2543 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:16.398115 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.398070 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:16.398238 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:16.398201 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:16.594424 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.594323 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" event={"ID":"94271ee8-5df1-4578-af2f-97bba140bd50","Type":"ContainerStarted","Data":"f53f42dc6a9d092672f415d0381f0e5d0eafcff2345f0f4bb777f553448637dd"} Oct 30 22:07:16.597167 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.597132 2543 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="8d85c861ab7f9e05c18bee578a48af55147cf9dc5b838b0ef4983750d0314755" exitCode=0 Oct 30 22:07:16.597296 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.597231 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerDied","Data":"8d85c861ab7f9e05c18bee578a48af55147cf9dc5b838b0ef4983750d0314755"} Oct 30 22:07:16.600768 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.600730 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kjm85" event={"ID":"13bd0c97-042f-4a9b-b685-e40d3480ae12","Type":"ContainerStarted","Data":"db147ead15a355d7131deb25666e0e42e1b6652d9ab8993e02923f2ce5e1eece"} Oct 30 22:07:16.600768 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.600754 2543 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:16.696283 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.696220 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" podStartSLOduration=2.407405454 podStartE2EDuration="10.696198133s" totalImagesPullingTime="8.288792679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:16.643821326 +0000 UTC m=+11.831438140" watchObservedRunningTime="2026-10-30 22:07:16.696198133 +0000 UTC m=+11.883814950" Oct 30 22:07:16.741797 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:16.741730 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-kjm85" podStartSLOduration=2.122123009 podStartE2EDuration="10.741708264s" totalImagesPullingTime="8.619585255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:16.740812424 +0000 UTC m=+11.928429257" watchObservedRunningTime="2026-10-30 22:07:16.741708264 +0000 UTC m=+11.929325083" Oct 30 22:07:17.401957 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:17.401909 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:17.401957 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:17.401952 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:17.402180 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:17.402070 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:17.402252 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:17.402188 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:17.606066 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:17.606026 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktczf" event={"ID":"5b612bcc-424f-40f3-ac06-7403ac235f75","Type":"ContainerStarted","Data":"40d3acb41175a5842573e750db498497173ae08d2b4cc1544d7ce4fab4dd69b4"} Oct 30 22:07:17.651581 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:17.651531 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ktczf" podStartSLOduration=3.406305161 podStartE2EDuration="11.651516817s" totalImagesPullingTime="8.245211656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:17.651473386 +0000 UTC m=+12.839090200" watchObservedRunningTime="2026-10-30 22:07:17.651516817 +0000 UTC m=+12.839133632" Oct 30 22:07:18.397990 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:18.397962 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:18.398138 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:18.398083 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:18.609570 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:18.609483 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" event={"ID":"8bf06513-3f43-4d61-9169-1cf2b37a0c64","Type":"ContainerStarted","Data":"84cb21d9847e7d8487eba9122e0387267f72efe23ff7c10c970970f9d05099db"} Oct 30 22:07:18.611912 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:18.611863 2543 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="e44af2357f221be0608116e3938330a655035683bf039d1c5c41a453a3ccadd8" exitCode=0 Oct 30 22:07:18.612022 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:18.611975 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerDied","Data":"e44af2357f221be0608116e3938330a655035683bf039d1c5c41a453a3ccadd8"} Oct 30 22:07:18.659975 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:18.659889 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" podStartSLOduration=1.942094309 podStartE2EDuration="12.659855892s" totalImagesPullingTime="10.717761583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:18.658777465 +0000 UTC m=+13.846394282" watchObservedRunningTime="2026-10-30 22:07:18.659855892 +0000 UTC m=+13.847472702" Oct 30 22:07:19.400453 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:19.400423 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:19.400453 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:19.400449 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:19.400655 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:19.400561 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:19.400721 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:19.400687 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:20.397722 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:20.397476 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:20.398182 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:20.397821 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:20.618650 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:20.618556 2543 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="7f1dcd36948f2e70b4a1be93873d4d5c1b3e7571677796c0bba8c1b9e00ae8a5" exitCode=0 Oct 30 22:07:20.618650 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:20.618602 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerDied","Data":"7f1dcd36948f2e70b4a1be93873d4d5c1b3e7571677796c0bba8c1b9e00ae8a5"} Oct 30 22:07:21.397711 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:21.397675 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:21.397905 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:21.397791 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:21.397905 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:21.397873 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:21.398259 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:21.397986 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:22.398018 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:22.397986 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:22.398425 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:22.398093 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:22.624326 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:22.624095 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"7fef43dcc8563795874c4f5ee89da0fc19d7b92f3eb38c09d34f55cc8d4f1674"} Oct 30 22:07:22.624438 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:22.624354 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"0f012b257e46147456c5c58626cee3574dc8bbc4e6089fcfe4c045ab1c734e5c"} Oct 30 22:07:22.624438 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:22.624395 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"aead8427a79d39014ac4b66a64f3199cac624ba889ea833a3f11f375c1081e7f"} Oct 30 22:07:22.626595 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:22.626570 2543 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="b68bedd497b13be2b78b68b757e2e9bec87ee671e269c3990e11c9223e56e9c3" exitCode=0 Oct 30 22:07:22.626677 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:22.626609 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerDied","Data":"b68bedd497b13be2b78b68b757e2e9bec87ee671e269c3990e11c9223e56e9c3"} Oct 30 22:07:23.009064 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.008984 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:23.009064 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.009032 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:23.009371 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.009132 2543 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:23.009371 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.009140 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:23.009371 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.009194 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.009182268 +0000 UTC m=+34.196799057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 22:07:23.009371 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.009209 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret podName:fae7117e-4b5b-4698-8369-825a1583d108 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.009203046 +0000 UTC m=+34.196819835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret") pod "global-pull-secret-syncer-dfsk2" (UID: "fae7117e-4b5b-4698-8369-825a1583d108") : object "kube-system"/"original-pull-secret" not registered Oct 30 22:07:23.109943 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.109902 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:23.110095 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.110038 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 22:07:23.110095 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.110053 2543 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 22:07:23.110095 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.110062 2543 projected.go:196] Error preparing data for projected volume kube-api-access-lpnnz for pod openshift-network-diagnostics/network-check-target-hv7wm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:23.110188 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.110111 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz podName:9ac149ae-bb65-4902-aa71-941f3ac65a8a nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.110096647 +0000 UTC m=+34.297713437 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lpnnz" (UniqueName: "kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz") pod "network-check-target-hv7wm" (UID: "9ac149ae-bb65-4902-aa71-941f3ac65a8a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 22:07:23.398229 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.398145 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:23.398815 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.398275 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:23.398815 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.398319 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:23.398815 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:23.398407 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:23.631434 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.631404 2543 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="fa5b248fbe8ecb723f11f8c43b54fad80b0c2e95e0a38ee141fcf7ee9ed54231" exitCode=0 Oct 30 22:07:23.631611 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.631487 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerDied","Data":"fa5b248fbe8ecb723f11f8c43b54fad80b0c2e95e0a38ee141fcf7ee9ed54231"} Oct 30 22:07:23.634392 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.634371 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"527bafb9db9de712f328da35624f4a74157664c915e1c60085ef3e06d8acca7b"} Oct 30 22:07:23.634471 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.634427 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"35a8356eb64464c18f1bf0020317ec71d547060122fa56efd74ce1fbfa64ec5a"} Oct 30 22:07:23.634471 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:23.634463 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"e73ed5de7c3742771e0ee212d7dc43906ab4a95d2baa785fc38e7b261340f5e5"} Oct 30 22:07:24.397811 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:24.397782 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:24.397980 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:24.397889 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:24.639680 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:24.639644 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" event={"ID":"11d96b43-b437-4dbf-92fb-7d21a7fc8060","Type":"ContainerStarted","Data":"a5a5597b571c9c0ac8c427349025646cae07f8f061c012c56cf0c0fab4eec15f"} Oct 30 22:07:24.714260 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:24.714158 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bh6l9" podStartSLOduration=7.517579344 podStartE2EDuration="18.714142578s" totalImagesPullingTime="11.196563234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:24.713582197 +0000 UTC m=+19.901199008" watchObservedRunningTime="2026-10-30 22:07:24.714142578 +0000 UTC m=+19.901759388" Oct 30 22:07:25.401104 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:25.401070 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:25.401296 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:25.401195 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:25.401296 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:25.401235 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:25.401397 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:25.401315 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:25.645445 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:25.645407 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"28559df044d0faa28cab7a1c273b9002791cfaf5e6df9af9ebe81172d80c7ffc"} Oct 30 22:07:26.397551 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:26.397515 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:26.397698 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:26.397617 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:27.252321 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.252197 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:27.252888 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.252340 2543 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:27.252888 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.252798 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:27.400445 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.400418 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:27.400573 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.400457 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:27.400573 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:27.400538 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:27.400653 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:27.400610 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:27.652674 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.652586 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" event={"ID":"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5","Type":"ContainerStarted","Data":"8fd763f5e46027d854d8fe501bb7357ba759e36f20400835a8cf4bffcd0e4aad"} Oct 30 22:07:27.746999 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:27.746953 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" podStartSLOduration=6.890148891 podStartE2EDuration="21.746938819s" totalImagesPullingTime="14.856789928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:27.746762758 +0000 UTC m=+22.934379585" watchObservedRunningTime="2026-10-30 22:07:27.746938819 +0000 UTC m=+22.934555630" Oct 30 22:07:28.397780 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.397746 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:28.398164 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:28.397848 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:28.655639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.655553 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:28.655789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.655644 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:28.655789 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.655695 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:28.675546 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.675516 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:28.675676 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.675669 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:28.969445 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.969353 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dfsk2"] Oct 30 22:07:28.969629 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.969497 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:28.969629 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:28.969580 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:28.972058 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.972032 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hv7wm"] Oct 30 22:07:28.972182 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.972155 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:28.972295 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:28.972269 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:28.972635 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.972613 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ts8xm"] Oct 30 22:07:28.972716 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:28.972706 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:28.972822 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:28.972801 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:30.397584 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:30.397556 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:30.398074 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:30.397556 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:30.398074 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:30.397656 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:30.398074 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:30.397556 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:30.398074 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:30.397742 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:30.398074 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:30.397796 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:32.398084 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:32.398036 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:32.398084 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:32.398080 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:32.398512 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:32.398164 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:32.398512 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:32.398204 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:32.398512 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:32.398288 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:32.398512 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:32.398367 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:34.397245 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:34.397216 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:34.397668 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:34.397232 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:34.397668 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:34.397323 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ts8xm" podUID="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" Oct 30 22:07:34.397668 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:34.397345 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:34.397668 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:34.397414 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hv7wm" podUID="9ac149ae-bb65-4902-aa71-941f3ac65a8a" Oct 30 22:07:34.397668 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:34.397477 2543 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dfsk2" podUID="fae7117e-4b5b-4698-8369-825a1583d108" Oct 30 22:07:35.162666 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.162498 2543 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeReady" Oct 30 22:07:35.162821 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.162774 2543 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 22:07:35.231648 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.231613 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pwj7j"] Oct 30 22:07:35.233808 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.233788 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tc4nf"] Oct 30 22:07:35.233968 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.233945 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.235824 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.235804 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.252633 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.252609 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk5lx\"" Oct 30 22:07:35.252773 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.252693 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-7vf6q\"" Oct 30 22:07:35.252773 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.252712 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 22:07:35.252871 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.252846 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 22:07:35.252917 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.252894 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 22:07:35.252961 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.252931 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 22:07:35.268284 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.268251 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pwj7j"] Oct 30 22:07:35.268999 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.268980 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tc4nf"] Oct 30 22:07:35.352800 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.352763 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 22:07:35.396762 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.396725 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743e187e-782e-427b-8484-5b85f36f6a37-cert\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.396950 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.396767 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9929a9-860d-44f5-810c-694da46d6b16-tmp-dir\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.396950 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.396887 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.396950 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.396917 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9s8\" (UniqueName: \"kubernetes.io/projected/3a9929a9-860d-44f5-810c-694da46d6b16-kube-api-access-5j9s8\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.397129 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.397103 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9929a9-860d-44f5-810c-694da46d6b16-config-volume\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.397187 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.397154 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5xwl\" (UniqueName: \"kubernetes.io/projected/743e187e-782e-427b-8484-5b85f36f6a37-kube-api-access-c5xwl\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.498215 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498130 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5xwl\" (UniqueName: \"kubernetes.io/projected/743e187e-782e-427b-8484-5b85f36f6a37-kube-api-access-c5xwl\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.498215 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498171 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743e187e-782e-427b-8484-5b85f36f6a37-cert\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.498215 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498200 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9929a9-860d-44f5-810c-694da46d6b16-tmp-dir\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.498639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498397 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.498639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498433 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9s8\" (UniqueName: \"kubernetes.io/projected/3a9929a9-860d-44f5-810c-694da46d6b16-kube-api-access-5j9s8\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.498639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498496 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9929a9-860d-44f5-810c-694da46d6b16-config-volume\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.498639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.498564 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9929a9-860d-44f5-810c-694da46d6b16-tmp-dir\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.498639 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:35.498568 2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:35.498783 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:35.498665 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls podName:3a9929a9-860d-44f5-810c-694da46d6b16 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:35.998646101 +0000 UTC m=+31.186262903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls") pod "dns-default-tc4nf" (UID: "3a9929a9-860d-44f5-810c-694da46d6b16") : secret "dns-default-metrics-tls" not found Oct 30 22:07:35.499050 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.499032 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9929a9-860d-44f5-810c-694da46d6b16-config-volume\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.502079 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.502063 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743e187e-782e-427b-8484-5b85f36f6a37-cert\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.523485 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.523450 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9s8\" (UniqueName: \"kubernetes.io/projected/3a9929a9-860d-44f5-810c-694da46d6b16-kube-api-access-5j9s8\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:35.523624 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.523523 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5xwl\" (UniqueName: \"kubernetes.io/projected/743e187e-782e-427b-8484-5b85f36f6a37-kube-api-access-c5xwl\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.545024 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.544996 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:35.850914 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:35.850890 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pwj7j"] Oct 30 22:07:35.852789 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:35.852764 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743e187e_782e_427b_8484_5b85f36f6a37.slice/crio-b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b WatchSource:0}: Error finding container b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b: Status 404 returned error can't find the container with id b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b Oct 30 22:07:36.003478 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.003437 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:36.003645 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:36.003597 2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:36.003684 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:36.003669 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls podName:3a9929a9-860d-44f5-810c-694da46d6b16 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:37.003653641 +0000 UTC m=+32.191270443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls") pod "dns-default-tc4nf" (UID: "3a9929a9-860d-44f5-810c-694da46d6b16") : secret "dns-default-metrics-tls" not found Oct 30 22:07:36.398022 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.397991 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:36.398022 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.398019 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:36.398230 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.398005 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:36.415200 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.415171 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 22:07:36.415337 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.415223 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nx2r\"" Oct 30 22:07:36.415387 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.415347 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 22:07:36.415387 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.415377 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmbsc\"" Oct 30 22:07:36.428425 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.428400 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 22:07:36.428554 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.428430 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gq78g\"" Oct 30 22:07:36.428554 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.428467 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 22:07:36.673846 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:36.673770 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pwj7j" event={"ID":"743e187e-782e-427b-8484-5b85f36f6a37","Type":"ContainerStarted","Data":"b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b"} Oct 30 22:07:37.011214 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.011134 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:37.011365 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:37.011316 2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:37.011412 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:37.011381 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls podName:3a9929a9-860d-44f5-810c-694da46d6b16 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.011366986 +0000 UTC m=+34.198983779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls") pod "dns-default-tc4nf" (UID: "3a9929a9-860d-44f5-810c-694da46d6b16") : secret "dns-default-metrics-tls" not found Oct 30 22:07:37.282673 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.282601 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ct89t"] Oct 30 22:07:37.285352 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.285336 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.314591 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.314458 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 22:07:37.314591 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.314484 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 22:07:37.314591 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.314500 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 22:07:37.314591 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.314500 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 22:07:37.314591 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.314559 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r7nlg\"" Oct 30 22:07:37.315662 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.315629 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ct89t"] Oct 30 22:07:37.359717 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.359676 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-qzm2l-7rzsf"] Oct 30 22:07:37.362979 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.362950 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.382164 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.382133 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-qzm2l-7rzsf"] Oct 30 22:07:37.402182 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.402146 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f5bxv\"" Oct 30 22:07:37.402182 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.402153 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 22:07:37.413987 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.413947 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rslkg\" (UniqueName: \"kubernetes.io/projected/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-api-access-rslkg\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.414170 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.414016 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12bf9532-314f-4f06-a71d-1007aa71b1a3-data-volume\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.414170 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.414096 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.414257 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.414168 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.414257 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.414221 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12bf9532-314f-4f06-a71d-1007aa71b1a3-crio-socket\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.429664 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.429624 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 22:07:37.514775 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.514718 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.514977 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.514783 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.514977 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.514895 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12bf9532-314f-4f06-a71d-1007aa71b1a3-crio-socket\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.514977 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:37.514917 2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:37.514977 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.514928 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.514977 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:37.514977 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:38.014961418 +0000 UTC m=+33.202578211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:37.515229 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515001 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rslkg\" (UniqueName: \"kubernetes.io/projected/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-api-access-rslkg\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.515229 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515093 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.515229 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515160 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12bf9532-314f-4f06-a71d-1007aa71b1a3-crio-socket\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.515229 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515189 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12bf9532-314f-4f06-a71d-1007aa71b1a3-data-volume\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.515229 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515225 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.515473 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:37.515293 2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:37.515473 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515324 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.515473 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:37.515364 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:38.015348376 +0000 UTC m=+33.202965190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : configmap "kube-rbac-proxy" not found Oct 30 22:07:37.515581 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.515552 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12bf9532-314f-4f06-a71d-1007aa71b1a3-data-volume\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.542417 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.542351 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rslkg\" (UniqueName: \"kubernetes.io/projected/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-api-access-rslkg\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:37.615940 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.615903 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.616112 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.615993 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.616112 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.616023 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.616112 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.616091 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.616487 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.616465 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.616733 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.616714 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.616959 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.616942 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.649240 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.649209 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.676685 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.676656 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:37.716772 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.716739 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f"] Oct 30 22:07:37.720676 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.720644 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:37.745254 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.745226 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4wqfg\"" Oct 30 22:07:37.745395 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.745268 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:37.745745 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.745726 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 22:07:37.746651 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.746630 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f"] Oct 30 22:07:37.818485 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.818403 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qchkh\" (UniqueName: \"kubernetes.io/projected/260f14ce-4b5e-4223-9120-b1da12ae9ec4-kube-api-access-qchkh\") pod \"migrator-66df5d496b-kcf7f\" (UID: \"260f14ce-4b5e-4223-9120-b1da12ae9ec4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:37.919209 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.919170 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qchkh\" (UniqueName: \"kubernetes.io/projected/260f14ce-4b5e-4223-9120-b1da12ae9ec4-kube-api-access-qchkh\") pod \"migrator-66df5d496b-kcf7f\" (UID: \"260f14ce-4b5e-4223-9120-b1da12ae9ec4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:37.944931 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.944896 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qchkh\" (UniqueName: \"kubernetes.io/projected/260f14ce-4b5e-4223-9120-b1da12ae9ec4-kube-api-access-qchkh\") pod \"migrator-66df5d496b-kcf7f\" (UID: \"260f14ce-4b5e-4223-9120-b1da12ae9ec4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:37.981261 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:37.981168 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-qzm2l-7rzsf"] Oct 30 22:07:37.983024 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:37.982981 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b58fb10_36f9_4a5a_b498_73867672bc21.slice/crio-b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3 WatchSource:0}: Error finding container b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3: Status 404 returned error can't find the container with id b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3 Oct 30 22:07:38.020477 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.020432 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:38.020650 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.020504 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:38.020650 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:38.020567 2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:38.020650 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:38.020622 2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:38.020650 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:38.020633 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.020614002 +0000 UTC m=+34.208230805 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : configmap "kube-rbac-proxy" not found Oct 30 22:07:38.020780 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:38.020666 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:39.020655864 +0000 UTC m=+34.208272652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:38.042697 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.042654 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:38.341884 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.341843 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f"] Oct 30 22:07:38.343805 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:38.343782 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260f14ce_4b5e_4223_9120_b1da12ae9ec4.slice/crio-6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f WatchSource:0}: Error finding container 6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f: Status 404 returned error can't find the container with id 6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f Oct 30 22:07:38.680452 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.680417 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pwj7j" event={"ID":"743e187e-782e-427b-8484-5b85f36f6a37","Type":"ContainerStarted","Data":"f42a3c837bb1f449b1d4a91a3804399ed9ddb28f743e6b89bec2383a2b0d5cec"} Oct 30 22:07:38.682060 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.682031 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" event={"ID":"260f14ce-4b5e-4223-9120-b1da12ae9ec4","Type":"ContainerStarted","Data":"6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f"} Oct 30 22:07:38.683240 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.683217 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" event={"ID":"5b58fb10-36f9-4a5a-b498-73867672bc21","Type":"ContainerStarted","Data":"b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3"} Oct 30 22:07:38.752558 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.752493 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pwj7j" podStartSLOduration=1.4802696 podStartE2EDuration="3.752474012s" totalImagesPullingTime="2.272204412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:38.75143657 +0000 UTC m=+33.939053372" watchObservedRunningTime="2026-10-30 22:07:38.752474012 +0000 UTC m=+33.940090824" Oct 30 22:07:38.776409 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.776368 2543 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-nzcwt"] Oct 30 22:07:38.782758 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.782730 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:38.799358 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.799016 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-nzcwt"] Oct 30 22:07:38.799358 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.799322 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 22:07:38.799567 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.799401 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 22:07:38.799567 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.799491 2543 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 22:07:38.799567 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.799506 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mvq4q\"" Oct 30 22:07:38.799695 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.799594 2543 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 22:07:38.930957 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.930690 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-cabundle\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:38.930957 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.930757 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-key\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:38.930957 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:38.930791 2543 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsk4p\" (UniqueName: \"kubernetes.io/projected/26a5be00-a033-4110-97a9-8dcf30361f2a-kube-api-access-dsk4p\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.032133 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032100 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:39.032303 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032148 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:39.032303 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032184 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-cabundle\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.032303 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032224 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:39.032303 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032275 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:39.032303 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032302 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-key\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.032590 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032344 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:39.032590 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.032371 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsk4p\" (UniqueName: \"kubernetes.io/projected/26a5be00-a033-4110-97a9-8dcf30361f2a-kube-api-access-dsk4p\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.032590 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032405 2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:39.032590 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032469 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls podName:3a9929a9-860d-44f5-810c-694da46d6b16 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:43.032449255 +0000 UTC m=+38.220066065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls") pod "dns-default-tc4nf" (UID: "3a9929a9-860d-44f5-810c-694da46d6b16") : secret "dns-default-metrics-tls" not found Oct 30 22:07:39.032800 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032654 2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:39.032800 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032721 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:41.032704376 +0000 UTC m=+36.220321179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : configmap "kube-rbac-proxy" not found Oct 30 22:07:39.032800 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032744 2543 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:39.032800 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032789 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:08:11.032775674 +0000 UTC m=+66.220392481 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : secret "metrics-daemon-secret" not found Oct 30 22:07:39.032800 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032798 2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:39.033076 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:39.032836 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:41.032824988 +0000 UTC m=+36.220441791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:39.033076 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.033060 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-cabundle\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.035147 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.035122 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:39.035739 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.035718 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-key\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.059227 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.059196 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsk4p\" (UniqueName: \"kubernetes.io/projected/26a5be00-a033-4110-97a9-8dcf30361f2a-kube-api-access-dsk4p\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.103291 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.103253 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:39.116943 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.116918 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:39.133730 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.133701 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:39.137298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.137270 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:39.411151 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.411121 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-nzcwt"] Oct 30 22:07:39.411227 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.411155 2543 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:39.413005 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:39.412967 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a5be00_a033_4110_97a9_8dcf30361f2a.slice/crio-bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3 WatchSource:0}: Error finding container bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3: Status 404 returned error can't find the container with id bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3 Oct 30 22:07:39.445639 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.445436 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dfsk2"] Oct 30 22:07:39.687902 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.687849 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" event={"ID":"26a5be00-a033-4110-97a9-8dcf30361f2a","Type":"ContainerStarted","Data":"bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3"} Oct 30 22:07:39.689896 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.689849 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dfsk2" event={"ID":"fae7117e-4b5b-4698-8369-825a1583d108","Type":"ContainerStarted","Data":"9b6cd66b20c8da15ab3f740f9768157d76edbdd7a0e88b505a923b241a60d0a4"} Oct 30 22:07:39.737297 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:39.737272 2543 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hv7wm"] Oct 30 22:07:39.739066 ip-10-0-139-44 kubenswrapper[2543]: W1030 22:07:39.739035 2543 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac149ae_bb65_4902_aa71_941f3ac65a8a.slice/crio-601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab WatchSource:0}: Error finding container 601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab: Status 404 returned error can't find the container with id 601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab Oct 30 22:07:40.695068 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:40.695033 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" event={"ID":"260f14ce-4b5e-4223-9120-b1da12ae9ec4","Type":"ContainerStarted","Data":"b3703c8582135fdb63c68b0ed527830f4b1b906a4408f47cb9f5851d2591a689"} Oct 30 22:07:40.697089 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:40.697054 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" event={"ID":"5b58fb10-36f9-4a5a-b498-73867672bc21","Type":"ContainerStarted","Data":"719590205d1e6a96992afb158ada9402e6e12cf2b8eff91280a976579e310b6e"} Oct 30 22:07:40.698598 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:40.698572 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hv7wm" event={"ID":"9ac149ae-bb65-4902-aa71-941f3ac65a8a","Type":"ContainerStarted","Data":"601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab"} Oct 30 22:07:40.742508 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:40.742446 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" podStartSLOduration=2.03469442 podStartE2EDuration="3.742428365s" totalImagesPullingTime="1.707733945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:40.741471177 +0000 UTC m=+35.929088012" watchObservedRunningTime="2026-10-30 22:07:40.742428365 +0000 UTC m=+35.930045180" Oct 30 22:07:40.788240 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:40.788172 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" podStartSLOduration=1.489920519 podStartE2EDuration="3.788157933s" totalImagesPullingTime="2.298237414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:40.78804175 +0000 UTC m=+35.975658588" watchObservedRunningTime="2026-10-30 22:07:40.788157933 +0000 UTC m=+35.975774745" Oct 30 22:07:41.052595 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:41.052399 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:41.052595 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:41.052463 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:41.052818 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:41.052587 2543 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 22:07:41.052818 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:41.052719 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:45.052703749 +0000 UTC m=+40.240320537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : configmap "kube-rbac-proxy" not found Oct 30 22:07:41.052818 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:41.052618 2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:41.052818 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:41.052797 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:45.052783156 +0000 UTC m=+40.240399949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:42.549522 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:42.549433 2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jxn8m_c717de0c-8143-4d25-926b-5f948a9d7903/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:42.697541 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:42.697461 2543 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jxn8m_c717de0c-8143-4d25-926b-5f948a9d7903/konnectivity-agent/0.log" limit=1024 Oct 30 22:07:42.708655 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:42.708619 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" event={"ID":"26a5be00-a033-4110-97a9-8dcf30361f2a","Type":"ContainerStarted","Data":"5b324d13d217696d4c3556107ce439b5a71a83bcd607df40bc3d483c272c67f7"} Oct 30 22:07:42.753878 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:42.753807 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" podStartSLOduration=1.729950524 podStartE2EDuration="4.753793351s" totalImagesPullingTime="3.023842827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:42.753270324 +0000 UTC m=+37.940887134" watchObservedRunningTime="2026-10-30 22:07:42.753793351 +0000 UTC m=+37.941410163" Oct 30 22:07:43.070588 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:43.070511 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:43.070742 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:43.070698 2543 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 22:07:43.070804 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:43.070778 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls podName:3a9929a9-860d-44f5-810c-694da46d6b16 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:51.070758691 +0000 UTC m=+46.258375494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls") pod "dns-default-tc4nf" (UID: "3a9929a9-860d-44f5-810c-694da46d6b16") : secret "dns-default-metrics-tls" not found Oct 30 22:07:43.713298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:43.713191 2543 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hv7wm" event={"ID":"9ac149ae-bb65-4902-aa71-941f3ac65a8a","Type":"ContainerStarted","Data":"6ea78d01e95de892695325843a0074b7fd9664c7d570cb60583239b1ca2828f8"} Oct 30 22:07:43.713298 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:43.713248 2543 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:43.771738 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:43.770959 2543 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hv7wm" podStartSLOduration=33.944982279 podStartE2EDuration="37.770938296s" totalImagesPullingTime="3.825956017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:43.77017916 +0000 UTC m=+38.957795972" watchObservedRunningTime="2026-10-30 22:07:43.770938296 +0000 UTC m=+38.958555108" Oct 30 22:07:43.816443 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:43.816294 2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kjm85_13bd0c97-042f-4a9b-b685-e40d3480ae12/dns-node-resolver/0.log" Oct 30 22:07:44.804358 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:44.804333 2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nm8gp_30416ea7-1ca2-4983-8de2-5e881a3a9717/node-ca/0.log" Oct 30 22:07:45.087786 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:45.087703 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:45.087786 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:45.087750 2543 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:45.087974 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:45.087845 2543 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:45.087974 ip-10-0-139-44 kubenswrapper[2543]: E1030 22:07:45.087923 2543 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:53.087908581 +0000 UTC m=+48.275525370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:45.088249 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:45.088228 2543 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:45.404497 ip-10-0-139-44 kubenswrapper[2543]: I1030 22:07:45.404470 2543 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pwj7j_743e187e-782e-427b-8484-5b85f36f6a37/serve-healthcheck-canary/0.log" Oct 30 22:07:45.550638 ip-10-0-139-44 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 22:07:45.566274 ip-10-0-139-44 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 22:07:45.566449 ip-10-0-139-44 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 22:07:45.566500 ip-10-0-139-44 systemd[1]: kubelet.service: Consumed 2.468s CPU time. Oct 30 22:07:45.579608 ip-10-0-139-44 systemd[1]: Starting Kubernetes Kubelet... Oct 30 22:07:45.653897 ip-10-0-139-44 kubenswrapper[4472]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:45.653897 ip-10-0-139-44 kubenswrapper[4472]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 22:07:45.653897 ip-10-0-139-44 kubenswrapper[4472]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:45.653897 ip-10-0-139-44 kubenswrapper[4472]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 22:07:45.655904 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655806 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.655904 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655903 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.655904 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655907 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655910 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655913 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655917 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655920 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655923 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655926 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655929 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655932 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655938 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655941 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655944 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655946 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655950 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655952 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655955 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655957 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655960 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655963 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655965 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.656001 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655968 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655971 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655973 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655976 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655978 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655981 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655984 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655986 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655991 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655995 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.655999 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656002 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656005 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656008 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656011 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656014 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656017 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656019 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656022 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.656508 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656025 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656027 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656030 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656032 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656035 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656037 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656040 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656042 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656045 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656047 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656050 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656052 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656055 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656057 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656059 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656062 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656066 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656070 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656073 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.656993 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656076 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656080 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656083 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656085 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656089 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656092 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656094 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656097 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656100 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656102 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656105 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656107 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656110 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656112 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656115 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656118 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656121 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656123 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656126 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656129 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.657452 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656131 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656134 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656137 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656140 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656142 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656145 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656148 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656151 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656154 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656156 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656159 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656161 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656164 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656167 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656169 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656172 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656175 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656177 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656180 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.657960 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656183 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656185 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656195 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656199 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656201 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656205 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656208 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656989 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.656997 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657001 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657003 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657006 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657009 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657013 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657016 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657018 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657021 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657024 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657026 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657029 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.658424 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657032 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657034 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657037 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657039 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657042 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657044 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657047 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657050 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657052 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657055 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657058 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657060 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657063 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657065 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657068 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657071 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657073 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657076 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657078 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.658973 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657081 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657084 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657091 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657093 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657096 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657099 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657102 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657104 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657107 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657109 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657113 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657115 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657118 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657121 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657123 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657126 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657128 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657131 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657133 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.659442 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657136 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657138 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657141 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657144 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657147 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657150 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657152 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657155 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657157 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657160 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657162 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657165 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657167 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657170 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657173 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657177 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657180 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657182 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657185 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657188 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.659919 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657190 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657193 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657195 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657198 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657202 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657206 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657209 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657212 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657215 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657217 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657220 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657223 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657225 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657228 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657231 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657233 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657236 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657239 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657243 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.660593 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657246 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657248 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657251 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657254 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657256 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657259 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657262 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657264 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657268 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657273 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657275 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657278 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657280 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657283 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657286 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657288 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657786 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657791 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657794 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657797 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.661087 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657800 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657802 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657806 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657808 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657811 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657813 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657816 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657819 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657821 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657824 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657826 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657829 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657832 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657834 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657837 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657839 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657842 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657844 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657847 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657849 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.661585 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657854 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657873 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657875 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657878 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657881 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657884 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657886 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657889 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657892 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657894 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657897 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657899 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657902 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657904 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657907 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657910 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657912 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657915 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657917 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657920 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.662084 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657923 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657925 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657928 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657930 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657933 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657936 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657939 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657941 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657944 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657946 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657949 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657951 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657956 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657966 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657970 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657974 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657977 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657980 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657983 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.662558 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657986 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657988 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657991 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657993 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657996 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.657998 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658001 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658003 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658006 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658009 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658011 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658014 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658016 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658019 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658021 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658024 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658026 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658029 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658031 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.663038 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658034 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658036 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658039 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658041 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658044 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658046 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658050 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658053 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658062 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658064 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658067 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658070 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658074 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658077 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658080 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658083 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658086 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658088 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658091 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.663492 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658093 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658096 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658099 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658102 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658105 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658196 4472 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658203 4472 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658210 4472 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658214 4472 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658219 4472 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658222 4472 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658226 4472 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658230 4472 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658234 4472 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658237 4472 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658258 4472 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658262 4472 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658266 4472 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658269 4472 flags.go:64] FLAG: --cgroup-root="" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658274 4472 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658278 4472 flags.go:64] FLAG: --client-ca-file="" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658282 4472 flags.go:64] FLAG: --cloud-provider="external" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658285 4472 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 22:07:45.664000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658289 4472 flags.go:64] FLAG: --cluster-domain="" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658292 4472 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658296 4472 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658299 4472 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658302 4472 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658306 4472 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658309 4472 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658312 4472 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658315 4472 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658318 4472 flags.go:64] FLAG: --contention-profiling="false" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658321 4472 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658324 4472 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658327 4472 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658330 4472 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658334 4472 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658338 4472 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658341 4472 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658343 4472 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658347 4472 flags.go:64] FLAG: --enable-server="true" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658350 4472 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658354 4472 flags.go:64] FLAG: --event-burst="100" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658358 4472 flags.go:64] FLAG: --event-qps="50" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658360 4472 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658364 4472 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 22:07:45.664595 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658366 4472 flags.go:64] FLAG: --eviction-hard="" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658371 4472 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658373 4472 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658376 4472 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658381 4472 flags.go:64] FLAG: --eviction-soft="" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658384 4472 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658387 4472 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658391 4472 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658394 4472 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658397 4472 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658400 4472 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658403 4472 flags.go:64] FLAG: --feature-gates="" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658407 4472 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658411 4472 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658414 4472 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658417 4472 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658420 4472 flags.go:64] FLAG: --healthz-port="10248" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658423 4472 flags.go:64] FLAG: --help="false" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658426 4472 flags.go:64] FLAG: --hostname-override="ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658429 4472 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658433 4472 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658436 4472 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658440 4472 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 22:07:45.665547 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658444 4472 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658447 4472 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658450 4472 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658453 4472 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658456 4472 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658459 4472 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658462 4472 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658465 4472 flags.go:64] FLAG: --kube-reserved="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658468 4472 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658471 4472 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658474 4472 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658477 4472 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658480 4472 flags.go:64] FLAG: --lock-file="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658483 4472 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658486 4472 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658489 4472 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658495 4472 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658498 4472 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658502 4472 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658505 4472 flags.go:64] FLAG: --logging-format="text" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658508 4472 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658511 4472 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658514 4472 flags.go:64] FLAG: --manifest-url="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658517 4472 flags.go:64] FLAG: --manifest-url-header="" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658521 4472 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 22:07:45.666548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658524 4472 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658528 4472 flags.go:64] FLAG: --max-pods="110" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658531 4472 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658534 4472 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658537 4472 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658540 4472 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658543 4472 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658546 4472 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658549 4472 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658555 4472 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658558 4472 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658562 4472 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658565 4472 flags.go:64] FLAG: --pod-cidr="" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658568 4472 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658571 4472 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658574 4472 flags.go:64] FLAG: --pods-per-core="0" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658577 4472 flags.go:64] FLAG: --port="10250" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658581 4472 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658585 4472 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0086ab58e7fdbce1a" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658588 4472 flags.go:64] FLAG: --qos-reserved="" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658591 4472 flags.go:64] FLAG: --read-only-port="10255" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658594 4472 flags.go:64] FLAG: --register-node="true" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658597 4472 flags.go:64] FLAG: --register-with-taints="" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658601 4472 flags.go:64] FLAG: --registry-burst="10" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658604 4472 flags.go:64] FLAG: --registry-qps="5" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658607 4472 flags.go:64] FLAG: --reserved-cpus="" Oct 30 22:07:45.667657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658610 4472 flags.go:64] FLAG: --reserved-memory="" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658614 4472 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658617 4472 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658621 4472 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658624 4472 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658627 4472 flags.go:64] FLAG: --runonce="false" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658629 4472 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658633 4472 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658635 4472 flags.go:64] FLAG: --seccomp-default="false" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658638 4472 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658641 4472 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658644 4472 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658648 4472 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658651 4472 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658654 4472 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658657 4472 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658660 4472 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658663 4472 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658666 4472 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658669 4472 flags.go:64] FLAG: --system-cgroups="" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658672 4472 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658677 4472 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658680 4472 flags.go:64] FLAG: --tls-cert-file="" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658685 4472 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658688 4472 flags.go:64] FLAG: --tls-min-version="" Oct 30 22:07:45.668853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658691 4472 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658694 4472 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658697 4472 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658700 4472 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658703 4472 flags.go:64] FLAG: --v="2" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658707 4472 flags.go:64] FLAG: --version="false" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658711 4472 flags.go:64] FLAG: --vmodule="" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658715 4472 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.658719 4472 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658851 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658869 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658874 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658878 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658882 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658887 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658890 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658894 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658897 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658900 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658902 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658905 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658908 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.670066 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658911 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658913 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658916 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658919 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658922 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658924 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658927 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658930 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658934 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658937 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658939 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658942 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658944 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658947 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658949 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658952 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658954 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658957 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658959 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.670717 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658962 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658967 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658970 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658972 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658975 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658978 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658981 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658983 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658986 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658989 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658992 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658994 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658997 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.658999 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659002 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659005 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659008 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659012 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659015 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.671363 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659019 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659021 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659025 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659028 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659031 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659033 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659036 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659038 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659041 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659043 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659046 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659049 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659051 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659054 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659059 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659062 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659064 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659067 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659069 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659072 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.671878 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659075 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659077 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659080 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659082 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659085 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659088 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659090 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659093 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659095 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659098 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659100 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659103 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659105 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659108 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659112 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659115 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659117 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659120 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659122 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.672389 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659125 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659128 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659132 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659136 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659139 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659142 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659145 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659149 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659152 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659154 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659157 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659160 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659163 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659165 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659168 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.672884 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659171 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.659196 4472 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659232 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659236 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659240 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659244 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659246 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659249 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659252 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659254 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659257 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659259 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659263 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659266 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659269 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659272 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.673395 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659274 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659277 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659280 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659282 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659285 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659287 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659290 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659292 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659295 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659298 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659302 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659305 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659307 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659310 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659313 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659315 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659318 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659320 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659323 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659325 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.673896 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659328 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659331 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659334 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659336 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659339 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659341 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659344 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659347 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659353 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659357 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659360 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659363 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659366 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659368 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659371 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659374 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659376 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659379 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.674419 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659381 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659384 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659386 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659390 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659393 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659396 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659399 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659402 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659405 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659407 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659410 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659413 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659415 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659418 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659420 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659423 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659425 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659428 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659430 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659433 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.674947 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659436 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659439 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659443 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659446 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659449 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659451 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659454 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659457 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659459 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659462 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659464 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659467 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659469 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659472 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659474 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659478 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659481 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659483 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659486 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.675438 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659489 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659492 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659494 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659497 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659499 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659502 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659505 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659507 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659510 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659512 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659515 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659518 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659520 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659525 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.659528 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.663190 4472 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.663212 4472 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.663228 4472 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.663233 4472 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 22:07:45.675956 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663288 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663293 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663297 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663300 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663303 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663305 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663308 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663311 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663313 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663316 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663320 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663324 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663329 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663334 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663337 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663339 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663344 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663348 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663351 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.676544 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663355 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663358 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663361 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663365 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663367 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663370 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663373 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663376 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663378 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663381 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663385 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663388 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663391 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663393 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663396 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663399 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663402 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663404 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663407 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663410 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.677288 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663412 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663415 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663417 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663420 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663423 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663426 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663429 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663431 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663434 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663437 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663439 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663442 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663445 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663448 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663451 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663454 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663456 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663459 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663461 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663464 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.677796 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663466 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663469 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663471 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663474 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663477 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663480 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663482 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663485 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663487 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663490 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663493 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663495 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663498 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663501 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663504 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663507 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663510 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663512 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663515 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.678334 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663518 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663520 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663523 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663526 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663528 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663531 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663534 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663537 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663539 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663542 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663545 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663547 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663550 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663552 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663556 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663560 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663563 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663566 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663569 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663572 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.678791 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663575 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663578 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663581 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663583 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663586 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663589 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663591 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663594 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.663623 4472 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663758 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663764 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663768 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663771 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663774 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663776 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663779 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.679281 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663782 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663785 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663787 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663790 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663793 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663795 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663798 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663800 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663803 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663805 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663808 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663812 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663815 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663819 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663824 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663827 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663830 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663832 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663835 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663837 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.679675 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663840 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663842 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663845 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663847 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663850 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663853 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663869 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663874 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663877 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663879 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663882 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663884 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663887 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663890 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663893 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663895 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663898 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663901 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663903 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.680178 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663906 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663908 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663910 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663913 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663916 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663918 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663921 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663924 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663927 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663930 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663932 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663935 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663938 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663940 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663943 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663945 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663948 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663950 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663953 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663955 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.680636 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663958 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663962 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663966 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663969 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663972 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663976 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663979 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663982 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663985 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663987 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663990 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663993 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663995 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.663998 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664000 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664003 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664006 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664008 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664011 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.681120 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664014 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664017 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664020 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664023 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664026 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664028 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664031 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664033 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664036 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664038 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664041 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664044 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664047 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664049 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664052 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664054 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664057 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664059 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664062 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664065 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.681634 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664067 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.664090 4472 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664122 4472 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664126 4472 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664129 4472 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664132 4472 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664135 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664138 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664141 4472 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664143 4472 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664146 4472 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664148 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664151 4472 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664153 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664156 4472 feature_gate.go:386] unrecognized feature gate: Example Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664159 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 22:07:45.682524 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664162 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664164 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664167 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664170 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664172 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664175 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664179 4472 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664181 4472 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664184 4472 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664198 4472 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664202 4472 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664204 4472 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664207 4472 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664209 4472 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664212 4472 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664215 4472 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664217 4472 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664220 4472 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664223 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 22:07:45.683160 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664226 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664228 4472 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664231 4472 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664234 4472 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664236 4472 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664239 4472 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664242 4472 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664244 4472 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664247 4472 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664250 4472 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664252 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664259 4472 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664262 4472 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664265 4472 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664268 4472 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664270 4472 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664273 4472 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664276 4472 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664280 4472 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 22:07:45.683685 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664284 4472 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664287 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664290 4472 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664297 4472 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664301 4472 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664303 4472 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664306 4472 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664309 4472 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664311 4472 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664314 4472 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664317 4472 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664319 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664322 4472 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664325 4472 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664328 4472 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664331 4472 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664334 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664336 4472 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664339 4472 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664342 4472 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 22:07:45.684378 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664344 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664347 4472 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664350 4472 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664352 4472 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664355 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664358 4472 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664360 4472 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664363 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664366 4472 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664369 4472 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664371 4472 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664374 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664376 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664379 4472 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664382 4472 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664386 4472 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664388 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664391 4472 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664394 4472 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664397 4472 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 22:07:45.684963 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664400 4472 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664402 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664405 4472 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664407 4472 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664410 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664413 4472 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664415 4472 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664418 4472 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664421 4472 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664424 4472 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664426 4472 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664429 4472 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664431 4472 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:45.664434 4472 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.664489 4472 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.667014 4472 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.667091 4472 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.667353 4472 server.go:1014] "Starting client certificate rotation" Oct 30 22:07:45.685488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.667477 4472 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.667525 4472 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 22:02:06 +0000 UTC" deadline="2028-03-26 01:28:41.818263986 +0000 UTC" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.667552 4472 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12291h20m56.150714034s" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.668082 4472 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.669740 4472 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.671276 4472 log.go:25] "Validated CRI v1 runtime API" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.672816 4472 log.go:25] "Validated CRI v1 image API" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.673554 4472 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 22:07:45.685987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.675043 4472 fs.go:135] Filesystem UUIDs: map[3f15da37-bd5f-4038-81bf-a6d5a94e78e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f634f008-7e61-4eb1-8379-f7a83752ebf6:/dev/nvme0n1p3] Oct 30 22:07:45.686203 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.675063 4472 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95/userdata/shm major:0 minor:77 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78230a4adb6cf240329f2bc2ec4146d0a0343f4ceb30cc9eeb71c48ac3addb98/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78230a4adb6cf240329f2bc2ec4146d0a0343f4ceb30cc9eeb71c48ac3addb98/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/79acd85702d56239d4e56da120f94cf9d7c724944633dd9ed4f1ecf09b18e505/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/79acd85702d56239d4e56da120f94cf9d7c724944633dd9ed4f1ecf09b18e505/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9b6cd66b20c8da15ab3f740f9768157d76edbdd7a0e88b505a923b241a60d0a4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9b6cd66b20c8da15ab3f740f9768157d76edbdd7a0e88b505a923b241a60d0a4/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3/userdata/shm major:0 minor:208 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3/userdata/shm major:0 minor:226 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/11d96b43-b437-4dbf-92fb-7d21a7fc8060/volumes/kubernetes.io~projected/kube-api-access-kthqb:{mountpoint:/var/lib/kubelet/pods/11d96b43-b437-4dbf-92fb-7d21a7fc8060/volumes/kubernetes.io~projected/kube-api-access-kthqb major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/12bf9532-314f-4f06-a71d-1007aa71b1a3/volumes/kubernetes.io~projected/kube-api-access-rslkg:{mountpoint:/var/lib/kubelet/pods/12bf9532-314f-4f06-a71d-1007aa71b1a3/volumes/kubernetes.io~projected/kube-api-access-rslkg major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/13bd0c97-042f-4a9b-b685-e40d3480ae12/volumes/kubernetes.io~projected/kube-api-access-9zndl:{mountpoint:/var/lib/kubelet/pods/13bd0c97-042f-4a9b-b685-e40d3480ae12/volumes/kubernetes.io~projected/kube-api-access-9zndl major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/260f14ce-4b5e-4223-9120-b1da12ae9ec4/volumes/kubernetes.io~projected/kube-api-access-qchkh:{mountpoint:/var/lib/kubelet/pods/260f14ce-4b5e-4223-9120-b1da12ae9ec4/volumes/kubernetes.io~projected/kube-api-access-qchkh major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26a5be00-a033-4110-97a9-8dcf30361f2a/volumes/kubernetes.io~projected/kube-api-access-dsk4p:{mountpoint:/var/lib/kubelet/pods/26a5be00-a033-4110-97a9-8dcf30361f2a/volumes/kubernetes.io~projected/kube-api-access-dsk4p major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26a5be00-a033-4110-97a9-8dcf30361f2a/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/26a5be00-a033-4110-97a9-8dcf30361f2a/volumes/kubernetes.io~secret/signing-key major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/30416ea7-1ca2-4983-8de2-5e881a3a9717/volumes/kubernetes.io~projected/kube-api-access-wggrj:{mountpoint:/var/lib/kubelet/pods/30416ea7-1ca2-4983-8de2-5e881a3a9717/volumes/kubernetes.io~projected/kube-api-access-wggrj major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3a9929a9-860d-44f5-810c-694da46d6b16/volumes/kubernetes.io~projected/kube-api-access-5j9s8:{mountpoint:/var/lib/kubelet/pods/3a9929a9-860d-44f5-810c-694da46d6b16/volumes/kubernetes.io~projected/kube-api-access-5j9s8 major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b58fb10-36f9-4a5a-b498-73867672bc21/volumes/kubernetes.io~projected/kube-api-access-x4nkl:{mountpoint:/var/lib/kubelet/pods/5b58fb10-36f9-4a5a-b498-73867672bc21/volumes/kubernetes.io~projected/kube-api-access-x4nkl major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5b612bcc-424f-40f3-ac06-7403ac235f75/volumes/kubernetes.io~projected/kube-api-access-s9f4z:{mountpoint:/var/lib/kubelet/pods/5b612bcc-424f-40f3-ac06-7403ac235f75/volumes/kubernetes.io~projected/kube-api-access-s9f4z major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/743e187e-782e-427b-8484-5b85f36f6a37/volumes/kubernetes.io~projected/kube-api-access-c5xwl:{mountpoint:/var/lib/kubelet/pods/743e187e-782e-427b-8484-5b85f36f6a37/volumes/kubernetes.io~projected/kube-api-access-c5xwl major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/743e187e-782e-427b-8484-5b85f36f6a37/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/743e187e-782e-427b-8484-5b85f36f6a37/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~empty-dir/tmp major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~projected/kube-api-access-xqxjt:{mountpoint:/var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~projected/kube-api-access-xqxjt major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/94271ee8-5df1-4578-af2f-97bba140bd50/volumes/kubernetes.io~projected/kube-api-access-fwvlx:{mountpoint:/var/lib/kubelet/pods/94271ee8-5df1-4578-af2f-97bba140bd50/volumes/kubernetes.io~projected/kube-api-access-fwvlx major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ac149ae-bb65-4902-aa71-941f3ac65a8a/volumes/kubernetes.io~projected/kube-api-access-lpnnz:{mountpoint:/var/lib/kubelet/pods/9ac149ae-bb65-4902-aa71-941f3ac65a8a/volumes/kubernetes.io~projected/kube-api-access-lpnnz major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c717de0c-8143-4d25-926b-5f948a9d7903/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/c717de0c-8143-4d25-926b-5f948a9d7903/volumes/kubernetes.io~secret/agent-certs major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d5e455a3-3e4a-4f60-aba1-0653a30b31f4/volumes/kubernetes.io~projected/kube-api-access-ljd8n:{mountpoint:/var/lib/kubelet/pods/d5e455a3-3e4a-4f60-aba1-0653a30b31f4/volumes/kubernetes.io~projected/kube-api-access-ljd8n major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volumes/kubernetes.io~projected/kube-api-access-72lvd:{mountpoint:/var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volumes/kubernetes.io~projected/kube-api-access-72lvd major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9b412a6-23fb-4c4a-91a6-bd60a71a668c/volumes/kubernetes.io~projected/kube-api-access-xxq44:{mountpoint:/var/lib/kubelet/pods/e9b412a6-23fb-4c4a-91a6-bd60a71a668c/volumes/kubernetes.io~projected/kube-api-access-xxq44 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fae7117e-4b5b-4698-8369-825a1583d108/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/fae7117e-4b5b-4698-8369-825a1583d108/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:223 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/a8471f82e73dc3943b655f9cf7a01e44c4962e5e1bbc713d635088b59ef59558/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/382eebf3167602533da11bdd5d95e6a4c07ef5948ec089cc1b71dd83581fb4a0/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/377661b3f7cfb994f2bb2a8067f1b43a29150cb2e929418a2394891ddbd3a9ef/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/7c79331ca0c33b021b87a2f34220ad01619a20910c7b7afb723ac97d47eab0e2/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/97f30ed8d4f801749b31ef4ad697235f30c2a3eb8b0e8f3733faa9e306acf36c/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/4e85d2ba8b135672ec7a62f50c0e42dd16b26939f18a8c6590b5950ca411144e/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/bd6ba8d5aeac879cda4733f169fd1f745691182b1996ca602b11a65c13e5db8e/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/e5dc2f03874a89feb566e3844475cc7216ed15548dd77ba6d38fb9e4b79d8af6/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/66bae779c17c2d0fe61bac03e72fd56d50505e481ed09ab28d369fa48682e29e/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/88a76686ca915b8e083e726f55f884ce755d537f629c665ac0ec63f7631c3f8c/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/2dc8573c988ca5240c92f0670f6c79a4d129a72c9927ff1b5f0221d6ca9a3989/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/1abdde3ca3af6b3615d41a9da39c1b1bd1b33a782303b58cff9d9ee3c71c2f0f/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/5bd812ba8d53d4cc1c16877713002c0ddb7e95053923cf44430bb9727ee62ade/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/f4f89beb27b27ab4619a906a6c54f3f656935f44cf50f7395cf74d6ffb15fdfd/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/2616e89c425fae05a0543ca3789ca85aa78248e58aa4ba4014cf96b512f5609b/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/c61057671c24e0b398cae59cf2e1ca171eafda5ab91fc7948178177910bd84c0/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/507eb18c35b8f26faa13762e10f3c05dffcfce4f7eec76b7eeef9ea173e0cdec/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/9798e5f8af6b7510706f700b871e78125c269f930a8ec714d98a747112a08a96/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-184:{mountpoint:/var/lib/containers/storage/overlay/8b08055eceb6a3cb3f0d59bc265a05e4eb75e707c7f665d49b6bc6295c2cfb73/merged major:0 minor:184 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/1cb06eb31a6fcec8837be6b0b84ee04d736e2d5943f4f9a37a36dcc9960c33dc/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/e26aa8753235d53618ce62d5e82938276a1878ae9c1a4a645e222a4af518cd00/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/c25c71f11a2e35c3bdcb916be864f5e402569f3b8d6070bd63acbb0608f8df31/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/c7d08645aab02bc6e9cb60b56d5a69ef0de35a69c8f5c0a92b356c95a67a4d18/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/c15b03ad426a5c8e2d77f69515209a8a87a17f4276235e8153a7bee49e809f35/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/eaf24390bd96c5ed47c2b830cad31dad3541e3b05b49db0a741a57372e59bfa6/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/d7344ffb368842003adffadca32b780a5a486885e02b868129bcb2ae63c485a5/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/b5c111e1186c654f85d8a32d87d1aaaa46f6db9b07f46ce92bbd204bcde275b6/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/15b5915bcb2ecab4ecc310aafbbfad2a400de13c455b7c82c3f32cdee9281dad/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/7bc585037cc4c19f50ea5e2f6311df845abf3279c2e72eaad8b8cb3d42c2999d/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/b5b91609223f005e15cd841655c6eeeb72340562cd44b2c3cf6087ecafafd59b/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/dd7cc5ace8f5a1658e225d0eccb659e04ff75b0595269ad605b7c79e0bc9513c/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/79cb60956000b10bc86547dddcf34014e4e8312a47583d3022c19e0ba86993f4/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/882e9d9985bea4a66e26bf97ab35af49bbef9f797c49109d01b5b6b51d5052a7/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/53041d527aa07bf89dcf4321bf0f9c88f8be7ffd86018c81870da41148e35f7f/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/ecccd5ac1e880a52a0595654cc61aef34e7421223f5f5b2087028575f7da2349/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/1a51b84e543a1901086c51c97b8f5f1b13efbc183fb25cf32c23e6ff3009a5f1/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/266f7c84a6e5af65c02dcda4cfc14c89fb118ab430bc2b7c12f9532573d9e46b/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-79:{mountpoint:/var/lib/containers/storage/overlay/fc7f80fa43c35bd5f50e333ebd4688bade00e1a2563715d12a9422ce4cb9cab4/merged major:0 minor:79 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/014ec74b65f6e5a1efba31eddf7b3515db207edb7f726c9cf980c2b9fd73b3ef/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/72ad4aee0be28aa2e26b3dd4707a51fd0edc165fba945870e1ea65de2b79122f/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/8bbbb1d54bc61509e126eb476883650deb434ead4a3fd32a6529f08c47382414/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/6f70390ffc0f8ea3e73bfb5651ca977247cf38d90474c42b729eec79802c3432/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/951b1e11f8abcdec8124b912514a259d619fff6df60337d488da3725d049b597/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681062 4472 manager.go:217] Machine: {Timestamp:2026-10-30 22:07:45.680599399 +0000 UTC m=+0.055141929 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100061 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ded66cb3d058c32d6ddb68575571 SystemUUID:ec26ded6-6cb3-d058-c32d-6ddb68575571 BootID:0e29875a-6469-41c1-8716-8c5f99a65c78 Filesystems:[{Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/26a5be00-a033-4110-97a9-8dcf30361f2a/volumes/kubernetes.io~projected/kube-api-access-dsk4p DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/79acd85702d56239d4e56da120f94cf9d7c724944633dd9ed4f1ecf09b18e505/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3a9929a9-860d-44f5-810c-694da46d6b16/volumes/kubernetes.io~projected/kube-api-access-5j9s8 DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/11d96b43-b437-4dbf-92fb-7d21a7fc8060/volumes/kubernetes.io~projected/kube-api-access-kthqb DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-79 DeviceMajor:0 DeviceMinor:79 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/743e187e-782e-427b-8484-5b85f36f6a37/volumes/kubernetes.io~projected/kube-api-access-c5xwl DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78230a4adb6cf240329f2bc2ec4146d0a0343f4ceb30cc9eeb71c48ac3addb98/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9b6cd66b20c8da15ab3f740f9768157d76edbdd7a0e88b505a923b241a60d0a4/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cac3e8969d7576acaf166464cd52473cecaaf705eb8e4a5962d176293159b43c/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/c717de0c-8143-4d25-926b-5f948a9d7903/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5b612bcc-424f-40f3-ac06-7403ac235f75/volumes/kubernetes.io~projected/kube-api-access-s9f4z DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/444891f1891cd72a986ee6f5510e05d84f7c47b8fb5713f498f31f6d482a8497/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/12bf9532-314f-4f06-a71d-1007aa71b1a3/volumes/kubernetes.io~projected/kube-api-access-rslkg DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5/volumes/kubernetes.io~projected/kube-api-access-72lvd DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-184 DeviceMajor:0 DeviceMinor:184 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/260f14ce-4b5e-4223-9120-b1da12ae9ec4/volumes/kubernetes.io~projected/kube-api-access-qchkh DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e9b412a6-23fb-4c4a-91a6-bd60a71a668c/volumes/kubernetes.io~projected/kube-api-access-xxq44 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/94271ee8-5df1-4578-af2f-97bba140bd50/volumes/kubernetes.io~projected/kube-api-access-fwvlx DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2be4cef1e91d7a7e05948439066a764ba7bbdc6993b66d6fb77e645e0b8c740f/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/15e76e03724b232d838f56a281e7103100edf096c4d6cf3a042603c960cf86fe/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3/userdata/shm DeviceMajor:0 DeviceMinor:208 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/26a5be00-a033-4110-97a9-8dcf30361f2a/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9ac149ae-bb65-4902-aa71-941f3ac65a8a/volumes/kubernetes.io~projected/kube-api-access-lpnnz DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3df9755fcd74bdd39e582a61de38278f9770ec0c78a23dc8c7f2a29a9991bf95/userdata/shm DeviceMajor:0 DeviceMinor:77 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/743e187e-782e-427b-8484-5b85f36f6a37/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5b58fb10-36f9-4a5a-b498-73867672bc21/volumes/kubernetes.io~projected/kube-api-access-x4nkl DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/13bd0c97-042f-4a9b-b685-e40d3480ae12/volumes/kubernetes.io~projected/kube-api-access-9zndl DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bfbfe89dae54e94cb6cdfb843f88aa66a48186035ac8c8906e116e8d3a4d57a3/userdata/shm DeviceMajor:0 DeviceMinor:226 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/601ba789d5807fe2cb2a446253cd6d33f0a4b52b6c4cb0bfdf3fd238d42ae8ab/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/30416ea7-1ca2-4983-8de2-5e881a3a9717/volumes/kubernetes.io~projected/kube-api-access-wggrj DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/d5e455a3-3e4a-4f60-aba1-0653a30b31f4/volumes/kubernetes.io~projected/kube-api-access-ljd8n DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e5ebcb7a98add151bf2346dcb5a8d4e522cdf9c4d269c47d096b7cfdf33f753/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b37867ac1aa40546bc1e7fe25262c9ffab70c7bd597c12fa99114107d6376f8b/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/fae7117e-4b5b-4698-8369-825a1583d108/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6277acba5b869f16f4d9db1b0b2eb5044c262f01bb1967643df0f697e6149b0f/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8bf06513-3f43-4d61-9169-1cf2b37a0c64/volumes/kubernetes.io~projected/kube-api-access-xqxjt DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:601ba789d5807fe MacAddress:c2:82:a8:58:26:35 Speed:10000 Mtu:8901} {Name:6277acba5b869f1 MacAddress:e6:57:b6:10:3b:bd Speed:10000 Mtu:8901} {Name:9b6cd66b20c8da1 MacAddress:c6:9b:55:87:a1:9b Speed:10000 Mtu:8901} {Name:b37867ac1aa4054 MacAddress:c2:61:77:e1:d7:eb Speed:10000 Mtu:8901} {Name:b4a4fbb836d8971 MacAddress:2e:43:33:16:58:1a Speed:10000 Mtu:8901} {Name:bfbfe89dae54e94 MacAddress:72:03:91:8a:73:65 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:c1:2a:69:bf Speed:0 Mtu:9001} {Name:br-int MacAddress:be:6d:db:27:ca:d9 Speed:0 Mtu:8901} {Name:ens5 MacAddress:02:ff:c1:2a:69:bf Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:8a:fa:62:11:56:9b Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5a:de:1f:2b:00:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681303 4472 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681343 4472 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681572 4472 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681592 4472 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681707 4472 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681789 4472 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681831 4472 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681855 4472 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.681992 4472 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682255 4472 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682398 4472 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682447 4472 kubelet.go:493] "Attempting to sync node with API server" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682465 4472 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682479 4472 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682496 4472 kubelet.go:405] "Adding apiserver pod source" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.682508 4472 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.683542 4472 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.683554 4472 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.684000 4472 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686263 4472 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 22:07:45.686346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686274 4472 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686366 4472 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686551 4472 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686578 4472 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686661 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686672 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686678 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686684 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686689 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686695 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686700 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686706 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686712 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686718 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686732 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686741 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686765 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 22:07:45.687089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.686771 4472 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 22:07:45.690035 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.690022 4472 server.go:1263] "Started kubelet" Oct 30 22:07:45.691528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.690112 4472 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 22:07:45.691528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.690149 4472 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 22:07:45.691528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.691131 4472 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 22:07:45.691528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.691376 4472 server.go:317] "Adding debug handlers to kubelet server" Oct 30 22:07:45.691528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.691474 4472 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 22:07:45.690566 ip-10-0-139-44 systemd[1]: Started Kubernetes Kubelet. Oct 30 22:07:45.693480 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.693266 4472 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 22:07:45.693621 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.693584 4472 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 22:07:45.694451 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.694419 4472 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 22:02:08 +0000 UTC" deadline="2028-05-13 07:06:04.380123611 +0000 UTC" Oct 30 22:07:45.694451 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.694450 4472 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13448h58m18.685675998s" Oct 30 22:07:45.694826 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.694807 4472 factory.go:55] Registering systemd factory Oct 30 22:07:45.694916 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.694831 4472 factory.go:223] Registration of the systemd container factory successfully Oct 30 22:07:45.695147 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:45.695128 4472 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-139-44.ec2.internal\" not found" Oct 30 22:07:45.695219 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.695195 4472 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 22:07:45.695219 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.695204 4472 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 22:07:45.695371 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.695355 4472 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 22:07:45.700529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.696412 4472 factory.go:153] Registering CRI-O factory Oct 30 22:07:45.700529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.696429 4472 factory.go:223] Registration of the crio container factory successfully Oct 30 22:07:45.700529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.696481 4472 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 22:07:45.700529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.696502 4472 factory.go:103] Registering Raw factory Oct 30 22:07:45.700529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.696527 4472 manager.go:1199] Started watching for new ooms in manager Oct 30 22:07:45.700529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.696937 4472 manager.go:319] Starting recovery of all containers Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700671 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13bd0c97-042f-4a9b-b685-e40d3480ae12" volumeName="kubernetes.io/empty-dir/13bd0c97-042f-4a9b-b685-e40d3480ae12-tmp-dir" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700712 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30416ea7-1ca2-4983-8de2-5e881a3a9717" volumeName="kubernetes.io/configmap/30416ea7-1ca2-4983-8de2-5e881a3a9717-serviceca" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700728 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a9929a9-860d-44f5-810c-694da46d6b16" volumeName="kubernetes.io/empty-dir/3a9929a9-860d-44f5-810c-694da46d6b16-tmp-dir" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700744 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4217e2e-ad4f-46c8-887c-22ac22d7b6d5" volumeName="kubernetes.io/projected/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-kube-api-access-72lvd" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700757 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12bf9532-314f-4f06-a71d-1007aa71b1a3" volumeName="kubernetes.io/projected/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-api-access-rslkg" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700768 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26a5be00-a033-4110-97a9-8dcf30361f2a" volumeName="kubernetes.io/projected/26a5be00-a033-4110-97a9-8dcf30361f2a-kube-api-access-dsk4p" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700783 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26a5be00-a033-4110-97a9-8dcf30361f2a" volumeName="kubernetes.io/secret/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-key" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700794 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12bf9532-314f-4f06-a71d-1007aa71b1a3" volumeName="kubernetes.io/empty-dir/12bf9532-314f-4f06-a71d-1007aa71b1a3-data-volume" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700813 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="260f14ce-4b5e-4223-9120-b1da12ae9ec4" volumeName="kubernetes.io/projected/260f14ce-4b5e-4223-9120-b1da12ae9ec4-kube-api-access-qchkh" seLinuxMountContext="" Oct 30 22:07:45.700854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700824 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26a5be00-a033-4110-97a9-8dcf30361f2a" volumeName="kubernetes.io/configmap/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-cabundle" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700896 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="30416ea7-1ca2-4983-8de2-5e881a3a9717" volumeName="kubernetes.io/projected/30416ea7-1ca2-4983-8de2-5e881a3a9717-kube-api-access-wggrj" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700912 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bf06513-3f43-4d61-9169-1cf2b37a0c64" volumeName="kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-tuned" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700923 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bf06513-3f43-4d61-9169-1cf2b37a0c64" volumeName="kubernetes.io/projected/8bf06513-3f43-4d61-9169-1cf2b37a0c64-kube-api-access-xqxjt" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700938 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c717de0c-8143-4d25-926b-5f948a9d7903" volumeName="kubernetes.io/secret/c717de0c-8143-4d25-926b-5f948a9d7903-agent-certs" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700953 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4217e2e-ad4f-46c8-887c-22ac22d7b6d5" volumeName="kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-config" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700969 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b612bcc-424f-40f3-ac06-7403ac235f75" volumeName="kubernetes.io/projected/5b612bcc-424f-40f3-ac06-7403ac235f75-kube-api-access-s9f4z" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700980 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8bf06513-3f43-4d61-9169-1cf2b37a0c64" volumeName="kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-tmp" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.700994 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b58fb10-36f9-4a5a-b498-73867672bc21" volumeName="kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701006 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ac149ae-bb65-4902-aa71-941f3ac65a8a" volumeName="kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701017 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4217e2e-ad4f-46c8-887c-22ac22d7b6d5" volumeName="kubernetes.io/secret/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701032 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9b412a6-23fb-4c4a-91a6-bd60a71a668c" volumeName="kubernetes.io/projected/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-kube-api-access-xxq44" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701043 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11d96b43-b437-4dbf-92fb-7d21a7fc8060" volumeName="kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701058 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="12bf9532-314f-4f06-a71d-1007aa71b1a3" volumeName="kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701069 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b58fb10-36f9-4a5a-b498-73867672bc21" volumeName="kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701080 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b612bcc-424f-40f3-ac06-7403ac235f75" volumeName="kubernetes.io/configmap/5b612bcc-424f-40f3-ac06-7403ac235f75-iptables-alerter-script" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701094 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94271ee8-5df1-4578-af2f-97bba140bd50" volumeName="kubernetes.io/projected/94271ee8-5df1-4578-af2f-97bba140bd50-kube-api-access-fwvlx" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701105 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4217e2e-ad4f-46c8-887c-22ac22d7b6d5" volumeName="kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-env-overrides" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701119 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9b412a6-23fb-4c4a-91a6-bd60a71a668c" volumeName="kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-daemon-config" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701141 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fae7117e-4b5b-4698-8369-825a1583d108" volumeName="kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701152 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b58fb10-36f9-4a5a-b498-73867672bc21" volumeName="kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701163 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5b58fb10-36f9-4a5a-b498-73867672bc21" volumeName="kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701179 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c717de0c-8143-4d25-926b-5f948a9d7903" volumeName="kubernetes.io/configmap/c717de0c-8143-4d25-926b-5f948a9d7903-konnectivity-ca" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701190 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d5e455a3-3e4a-4f60-aba1-0653a30b31f4" volumeName="kubernetes.io/projected/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-kube-api-access-ljd8n" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701205 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4217e2e-ad4f-46c8-887c-22ac22d7b6d5" volumeName="kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-script-lib" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701215 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9b412a6-23fb-4c4a-91a6-bd60a71a668c" volumeName="kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cni-binary-copy" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701229 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11d96b43-b437-4dbf-92fb-7d21a7fc8060" volumeName="kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-binary-copy" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701243 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13bd0c97-042f-4a9b-b685-e40d3480ae12" volumeName="kubernetes.io/projected/13bd0c97-042f-4a9b-b685-e40d3480ae12-kube-api-access-9zndl" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701254 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a9929a9-860d-44f5-810c-694da46d6b16" volumeName="kubernetes.io/configmap/3a9929a9-860d-44f5-810c-694da46d6b16-config-volume" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701270 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3a9929a9-860d-44f5-810c-694da46d6b16" volumeName="kubernetes.io/projected/3a9929a9-860d-44f5-810c-694da46d6b16-kube-api-access-5j9s8" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701281 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="743e187e-782e-427b-8484-5b85f36f6a37" volumeName="kubernetes.io/projected/743e187e-782e-427b-8484-5b85f36f6a37-kube-api-access-c5xwl" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701291 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="743e187e-782e-427b-8484-5b85f36f6a37" volumeName="kubernetes.io/secret/743e187e-782e-427b-8484-5b85f36f6a37-cert" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701312 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11d96b43-b437-4dbf-92fb-7d21a7fc8060" volumeName="kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701324 4472 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="11d96b43-b437-4dbf-92fb-7d21a7fc8060" volumeName="kubernetes.io/projected/11d96b43-b437-4dbf-92fb-7d21a7fc8060-kube-api-access-kthqb" seLinuxMountContext="" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701334 4472 reconstruct.go:97] "Volume reconstruction finished" Oct 30 22:07:45.701348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.701341 4472 reconciler.go:29] "Reconciler: start to sync state" Oct 30 22:07:45.725118 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.725083 4472 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 22:07:45.727583 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.727558 4472 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 22:07:45.727583 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.727580 4472 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 22:07:45.727733 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.727596 4472 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 22:07:45.727733 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:45.727629 4472 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 22:07:45.751822 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.751587 4472 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:45.752006 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.751838 4472 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 22:07:45.752294 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.752263 4472 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:45.765513 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.765487 4472 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:45.765996 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.765972 4472 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 22:07:45.770248 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.770216 4472 generic.go:356] "Generic (PLEG): container finished" podID="8e73e1006f70395d6db6b83f01253f3d" containerID="d802c259275b4d5c376cf05f1b155d1fb58e50ea35af66779611deaf15e949dd" exitCode=0 Oct 30 22:07:45.779098 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.779080 4472 manager.go:324] Recovery completed Oct 30 22:07:45.780425 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.780398 4472 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="fa5b248fbe8ecb723f11f8c43b54fad80b0c2e95e0a38ee141fcf7ee9ed54231" exitCode=0 Oct 30 22:07:45.780425 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.780425 4472 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="b68bedd497b13be2b78b68b757e2e9bec87ee671e269c3990e11c9223e56e9c3" exitCode=0 Oct 30 22:07:45.780541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.780436 4472 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="7f1dcd36948f2e70b4a1be93873d4d5c1b3e7571677796c0bba8c1b9e00ae8a5" exitCode=0 Oct 30 22:07:45.780541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.780444 4472 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="e44af2357f221be0608116e3938330a655035683bf039d1c5c41a453a3ccadd8" exitCode=0 Oct 30 22:07:45.780541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.780452 4472 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="8d85c861ab7f9e05c18bee578a48af55147cf9dc5b838b0ef4983750d0314755" exitCode=0 Oct 30 22:07:45.780541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.780459 4472 generic.go:356] "Generic (PLEG): container finished" podID="11d96b43-b437-4dbf-92fb-7d21a7fc8060" containerID="61af6b53c8ec9afb6ec351647499a56740b944bf111810d68a3c566eb477206d" exitCode=0 Oct 30 22:07:45.794677 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794659 4472 cpu_manager.go:226] "Starting" policy="none" Oct 30 22:07:45.794677 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794673 4472 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 22:07:45.794807 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794690 4472 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 22:07:45.794807 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794801 4472 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 22:07:45.794890 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794812 4472 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 22:07:45.794890 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794829 4472 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 22:07:45.794890 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794835 4472 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 22:07:45.794890 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794840 4472 policy_none.go:50] "Start" Oct 30 22:07:45.794890 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794847 4472 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 22:07:45.794890 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.794868 4472 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 22:07:45.800573 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.800557 4472 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 22:07:45.800573 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.800574 4472 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 22:07:45.800648 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.800580 4472 policy_none.go:44] "Start" Oct 30 22:07:45.804758 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.804730 4472 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 22:07:45.807870 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.807846 4472 manager.go:341] "Starting Device Plugin manager" Oct 30 22:07:45.808408 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:45.807918 4472 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 22:07:45.808408 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808410 4472 server.go:87] "Starting device plugin registration server" Oct 30 22:07:45.808696 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808682 4472 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 22:07:45.808769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808696 4472 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 22:07:45.808817 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808807 4472 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 22:07:45.808937 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808904 4472 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 22:07:45.808976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808947 4472 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 22:07:45.808976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.808955 4472 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 22:07:45.809117 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.809009 4472 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T22:07:45.80893627Z","UUID":"0084dd65-e253-4480-8289-ebb6b4a04cb6","Handler":null,"Name":"","Endpoint":""} Oct 30 22:07:45.810330 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.810315 4472 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 22:07:45.810415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.810338 4472 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 22:07:45.810912 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:45.810893 4472 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 22:07:45.828239 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.828180 4472 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal"] Oct 30 22:07:45.828989 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.828956 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" event={"ID":"c871cf99dd9dbde7be3b85cc0f154c8c","Type":"ContainerStarted","Data":"177c13c689b9566367988756c2841184c55ab600af7e6d5cad72c35275bda7fb"} Oct 30 22:07:45.829082 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.828998 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" event={"ID":"c871cf99dd9dbde7be3b85cc0f154c8c","Type":"ContainerStarted","Data":"c800ebaaddcfe240489dea71ac33d70c538c9012de848ebd4665b62519a3fe77"} Oct 30 22:07:45.829082 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.829064 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" event={"ID":"8e73e1006f70395d6db6b83f01253f3d","Type":"ContainerStarted","Data":"4c4f72b13cf6d58bcf9d5e11a40623636706b831c79cdf613166596c677d84c5"} Oct 30 22:07:45.829082 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.829077 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" event={"ID":"8e73e1006f70395d6db6b83f01253f3d","Type":"ContainerDied","Data":"d802c259275b4d5c376cf05f1b155d1fb58e50ea35af66779611deaf15e949dd"} Oct 30 22:07:45.829234 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.829090 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" event={"ID":"8e73e1006f70395d6db6b83f01253f3d","Type":"ContainerStarted","Data":"38ab039157ef411be1ed848a0f3ffdf38f3794ebed35c5a3602559645fddf8a9"} Oct 30 22:07:45.829234 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.829152 4472 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.829234 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.829179 4472 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.853471 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.853450 4472 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:45.853569 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:45.853488 4472 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.854382 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.854361 4472 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:45.854475 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:45.854395 4472 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.909133 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.909063 4472 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 22:07:45.910488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.910469 4472 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientMemory" Oct 30 22:07:45.910587 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.910499 4472 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 22:07:45.910587 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.910510 4472 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-139-44.ec2.internal" event="NodeHasSufficientPID" Oct 30 22:07:45.910587 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.910549 4472 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.947282 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.947259 4472 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.947385 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.947328 4472 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.952452 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.952425 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.952540 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.952462 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c871cf99dd9dbde7be3b85cc0f154c8c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" (UID: \"c871cf99dd9dbde7be3b85cc0f154c8c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:45.952540 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:45.952480 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.052979 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.052942 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.052979 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.052966 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.053148 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.053003 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.053148 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.053057 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e73e1006f70395d6db6b83f01253f3d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" (UID: \"8e73e1006f70395d6db6b83f01253f3d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.053148 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.053072 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c871cf99dd9dbde7be3b85cc0f154c8c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" (UID: \"c871cf99dd9dbde7be3b85cc0f154c8c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.053148 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.053096 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c871cf99dd9dbde7be3b85cc0f154c8c-config\") pod \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" (UID: \"c871cf99dd9dbde7be3b85cc0f154c8c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.683562 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.683524 4472 apiserver.go:52] "Watching apiserver" Oct 30 22:07:46.748566 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.748531 4472 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 22:07:46.749116 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.749092 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-hv7wm","openshift-multus/multus-cqvt9","openshift-multus/multus-additional-cni-plugins-bh6l9","kube-system/konnectivity-agent-jxn8m","openshift-dns/node-resolver-kjm85","kube-system/global-pull-secret-syncer-dfsk2","openshift-image-registry/node-ca-nm8gp","openshift-multus/network-metrics-daemon-ts8xm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4","openshift-insights/insights-runtime-extractor-ct89t","openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f","openshift-dns/dns-default-tc4nf","openshift-insights/periodic-gathering-qzm2l-7rzsf","openshift-service-ca/service-ca-5fffc97bdf-nzcwt","openshift-network-operator/iptables-alerter-ktczf","openshift-ingress-canary/ingress-canary-pwj7j","openshift-cluster-node-tuning-operator/tuned-hkdv6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-v9p8m","kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal"] Oct 30 22:07:46.755577 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.755552 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:46.756413 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.756393 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.757576 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.757559 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.766058 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766032 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.766058 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766039 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.766207 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766039 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9t4n\"" Oct 30 22:07:46.766207 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766070 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.766207 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766113 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x4nws\"" Oct 30 22:07:46.766207 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766133 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 22:07:46.766207 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.766177 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.776797 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.776780 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 22:07:46.777075 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777061 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.777134 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777090 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-22mqf\"" Oct 30 22:07:46.777134 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777115 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 22:07:46.777216 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777139 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.777216 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777159 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 22:07:46.777380 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777366 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.777474 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777391 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.777474 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777400 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 22:07:46.777474 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777435 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 22:07:46.777474 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777437 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 22:07:46.777474 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777449 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 22:07:46.777664 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777489 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.777664 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777542 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-gq78g\"" Oct 30 22:07:46.777664 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777659 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 22:07:46.777751 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777691 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 22:07:46.777953 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777940 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vdq5j\"" Oct 30 22:07:46.778002 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.777961 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 22:07:46.778037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.778013 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f5bxv\"" Oct 30 22:07:46.778079 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.778070 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.778127 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.778080 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-7vf6q\"" Oct 30 22:07:46.778209 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.778196 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.778267 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.778252 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 22:07:46.780508 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.780483 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.780774 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.780744 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.780893 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.780869 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.780893 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.780879 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.781030 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781009 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 22:07:46.781148 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781132 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 22:07:46.781238 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781219 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.781285 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781247 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.781393 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781341 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pjfxj\"" Oct 30 22:07:46.781443 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781382 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 22:07:46.781488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781464 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.781488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781476 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5nx2r\"" Oct 30 22:07:46.781571 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781489 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.781713 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781697 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 22:07:46.781831 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781809 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.781974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.781956 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.782035 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782020 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.782163 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782129 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 22:07:46.782222 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782205 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 22:07:46.782265 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782202 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 22:07:46.782408 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782375 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfzqs\"" Oct 30 22:07:46.782457 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782417 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 22:07:46.782953 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.782936 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 22:07:46.783437 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.783423 4472 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.783586 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.783573 4472 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.789773 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.789754 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 22:07:46.789882 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.789843 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4wqfg\"" Oct 30 22:07:46.790003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.789985 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 22:07:46.790126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790010 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mvq4q\"" Oct 30 22:07:46.790126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790040 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zgfdn\"" Oct 30 22:07:46.790126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790064 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 22:07:46.790531 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790516 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hk5lx\"" Oct 30 22:07:46.790582 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790524 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-7l7rd\"" Oct 30 22:07:46.790647 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790635 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 22:07:46.790824 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790810 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r7nlg\"" Oct 30 22:07:46.790886 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790835 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dzfp9\"" Oct 30 22:07:46.790886 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.790852 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-hmbsc\"" Oct 30 22:07:46.794973 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.794951 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 22:07:46.798414 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.798397 4472 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 22:07:46.806270 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.806248 4472 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:46.806333 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:46.806287 4472 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-139-44.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.812496 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.812482 4472 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 22:07:46.812542 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:46.812517 4472 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-44.ec2.internal" Oct 30 22:07:46.855628 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855600 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cni-binary-copy\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.855748 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855636 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-multus\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.855748 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855663 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-tmp\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.855898 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855764 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-tmp\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.855898 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855781 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b612bcc-424f-40f3-ac06-7403ac235f75-host-slash\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.855898 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855846 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9f4z\" (UniqueName: \"kubernetes.io/projected/5b612bcc-424f-40f3-ac06-7403ac235f75-kube-api-access-s9f4z\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.856042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855897 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.856042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855922 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.856042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855950 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-multus-certs\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.856042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.855975 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-kubelet-config\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.856042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856000 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-etc-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856026 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-netd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856041 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cni-binary-copy\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.856275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856108 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.856275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856124 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856153 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72lvd\" (UniqueName: \"kubernetes.io/projected/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-kube-api-access-72lvd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856199 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30416ea7-1ca2-4983-8de2-5e881a3a9717-host\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.856275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856241 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856301 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b612bcc-424f-40f3-ac06-7403ac235f75-iptables-alerter-script\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856327 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856344 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856363 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kthqb\" (UniqueName: \"kubernetes.io/projected/11d96b43-b437-4dbf-92fb-7d21a7fc8060-kube-api-access-kthqb\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856389 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-sys-fs\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856415 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvlx\" (UniqueName: \"kubernetes.io/projected/94271ee8-5df1-4578-af2f-97bba140bd50-kube-api-access-fwvlx\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.856515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856469 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-kubelet\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856527 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-daemon-config\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856579 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-tuned\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856614 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-system-cni-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856643 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-systemd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856671 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856676 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-tuned\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856699 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b612bcc-424f-40f3-ac06-7403ac235f75-iptables-alerter-script\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856752 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-config\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.856811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856761 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-daemon-config\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856909 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-script-lib\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856944 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.856975 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-system-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857017 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-config\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857066 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cnibin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857099 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-modprobe-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857126 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-lib-modules\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857147 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857156 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxq44\" (UniqueName: \"kubernetes.io/projected/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-kube-api-access-xxq44\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857157 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovnkube-script-lib\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.857259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857198 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857273 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-conf\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857306 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857424 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-systemd-units\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857451 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857457 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-netns\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857509 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-ovn\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857526 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12bf9532-314f-4f06-a71d-1007aa71b1a3-crio-socket\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857540 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-host\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857545 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857564 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9929a9-860d-44f5-810c-694da46d6b16-config-volume\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.857603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857596 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857646 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd0c97-042f-4a9b-b685-e40d3480ae12-hosts-file\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857741 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-socket-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857750 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3a9929a9-860d-44f5-810c-694da46d6b16-config-volume\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857764 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857799 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggrj\" (UniqueName: \"kubernetes.io/projected/30416ea7-1ca2-4983-8de2-5e881a3a9717-kube-api-access-wggrj\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857903 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-conf-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857949 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12bf9532-314f-4f06-a71d-1007aa71b1a3-data-volume\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.858014 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.857978 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-sys\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858037 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqxjt\" (UniqueName: \"kubernetes.io/projected/8bf06513-3f43-4d61-9169-1cf2b37a0c64-kube-api-access-xqxjt\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858064 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-dbus\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858082 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c717de0c-8143-4d25-926b-5f948a9d7903-agent-certs\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858097 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858117 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysconfig\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858040 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/12bf9532-314f-4f06-a71d-1007aa71b1a3-data-volume\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858134 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858149 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zndl\" (UniqueName: \"kubernetes.io/projected/13bd0c97-042f-4a9b-b685-e40d3480ae12-kube-api-access-9zndl\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858184 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-var-lib-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858202 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-node-log\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858232 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-env-overrides\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858311 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:46.858383 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858351 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-systemd\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858401 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-env-overrides\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858414 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858430 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c717de0c-8143-4d25-926b-5f948a9d7903-agent-certs\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858475 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-registration-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858500 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30416ea7-1ca2-4983-8de2-5e881a3a9717-serviceca\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858517 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qchkh\" (UniqueName: \"kubernetes.io/projected/260f14ce-4b5e-4223-9120-b1da12ae9ec4-kube-api-access-qchkh\") pod \"migrator-66df5d496b-kcf7f\" (UID: \"260f14ce-4b5e-4223-9120-b1da12ae9ec4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858533 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-socket-dir-parent\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858551 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-netns\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858566 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-slash\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858583 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858599 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-etc-kubernetes\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858618 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-cabundle\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858649 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-kubernetes\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858686 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c717de0c-8143-4d25-926b-5f948a9d7903-konnectivity-ca\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858778 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-cabundle\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858805 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd0c97-042f-4a9b-b685-e40d3480ae12-tmp-dir\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858830 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-device-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.858892 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858871 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-key\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858925 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13bd0c97-042f-4a9b-b685-e40d3480ae12-tmp-dir\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858928 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c717de0c-8143-4d25-926b-5f948a9d7903-konnectivity-ca\") pod \"konnectivity-agent-jxn8m\" (UID: \"c717de0c-8143-4d25-926b-5f948a9d7903\") " pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858968 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-run\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858985 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-ovn-node-metrics-cert\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.858998 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-hostroot\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859029 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859048 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rslkg\" (UniqueName: \"kubernetes.io/projected/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-api-access-rslkg\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859082 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/26a5be00-a033-4110-97a9-8dcf30361f2a-signing-key\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859101 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859146 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cnibin\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859195 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859242 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859287 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/30416ea7-1ca2-4983-8de2-5e881a3a9717-serviceca\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859287 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-k8s-cni-cncf-io\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859322 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-bin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859340 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5xwl\" (UniqueName: \"kubernetes.io/projected/743e187e-782e-427b-8484-5b85f36f6a37-kube-api-access-c5xwl\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859355 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859381 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-log-socket\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859395 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-bin\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859411 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljd8n\" (UniqueName: \"kubernetes.io/projected/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-kube-api-access-ljd8n\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859425 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-kubelet\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859462 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-var-lib-kubelet\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859493 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.859520 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859522 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743e187e-782e-427b-8484-5b85f36f6a37-cert\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859569 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9929a9-860d-44f5-810c-694da46d6b16-tmp-dir\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859591 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9s8\" (UniqueName: \"kubernetes.io/projected/3a9929a9-860d-44f5-810c-694da46d6b16-kube-api-access-5j9s8\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859607 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859627 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsk4p\" (UniqueName: \"kubernetes.io/projected/26a5be00-a033-4110-97a9-8dcf30361f2a-kube-api-access-dsk4p\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859701 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/743e187e-782e-427b-8484-5b85f36f6a37-cert\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859705 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9929a9-860d-44f5-810c-694da46d6b16-tmp-dir\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859781 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fae7117e-4b5b-4698-8369-825a1583d108-original-pull-secret\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.860299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.859793 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/11d96b43-b437-4dbf-92fb-7d21a7fc8060-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.878984 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.878958 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") pod \"periodic-gathering-qzm2l-7rzsf\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:07:46.878984 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.878976 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9f4z\" (UniqueName: \"kubernetes.io/projected/5b612bcc-424f-40f3-ac06-7403ac235f75-kube-api-access-s9f4z\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.879513 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.879497 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72lvd\" (UniqueName: \"kubernetes.io/projected/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-kube-api-access-72lvd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.879550 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.879533 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kthqb\" (UniqueName: \"kubernetes.io/projected/11d96b43-b437-4dbf-92fb-7d21a7fc8060-kube-api-access-kthqb\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.880517 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.880493 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zndl\" (UniqueName: \"kubernetes.io/projected/13bd0c97-042f-4a9b-b685-e40d3480ae12-kube-api-access-9zndl\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.880611 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.880527 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wggrj\" (UniqueName: \"kubernetes.io/projected/30416ea7-1ca2-4983-8de2-5e881a3a9717-kube-api-access-wggrj\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.880611 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.880591 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvlx\" (UniqueName: \"kubernetes.io/projected/94271ee8-5df1-4578-af2f-97bba140bd50-kube-api-access-fwvlx\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.880678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.880593 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqxjt\" (UniqueName: \"kubernetes.io/projected/8bf06513-3f43-4d61-9169-1cf2b37a0c64-kube-api-access-xqxjt\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.880678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.880599 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxq44\" (UniqueName: \"kubernetes.io/projected/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-kube-api-access-xxq44\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.881395 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.881378 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qchkh\" (UniqueName: \"kubernetes.io/projected/260f14ce-4b5e-4223-9120-b1da12ae9ec4-kube-api-access-qchkh\") pod \"migrator-66df5d496b-kcf7f\" (UID: \"260f14ce-4b5e-4223-9120-b1da12ae9ec4\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-kcf7f" Oct 30 22:07:46.882033 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.882014 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpnnz\" (UniqueName: \"kubernetes.io/projected/9ac149ae-bb65-4902-aa71-941f3ac65a8a-kube-api-access-lpnnz\") pod \"network-check-target-hv7wm\" (UID: \"9ac149ae-bb65-4902-aa71-941f3ac65a8a\") " pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:46.882374 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.882357 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rslkg\" (UniqueName: \"kubernetes.io/projected/12bf9532-314f-4f06-a71d-1007aa71b1a3-kube-api-access-rslkg\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.885790 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.885774 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljd8n\" (UniqueName: \"kubernetes.io/projected/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-kube-api-access-ljd8n\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:46.885853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.885838 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsk4p\" (UniqueName: \"kubernetes.io/projected/26a5be00-a033-4110-97a9-8dcf30361f2a-kube-api-access-dsk4p\") pod \"service-ca-5fffc97bdf-nzcwt\" (UID: \"26a5be00-a033-4110-97a9-8dcf30361f2a\") " pod="openshift-service-ca/service-ca-5fffc97bdf-nzcwt" Oct 30 22:07:46.885901 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.885838 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9s8\" (UniqueName: \"kubernetes.io/projected/3a9929a9-860d-44f5-810c-694da46d6b16-kube-api-access-5j9s8\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.886114 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.886098 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5xwl\" (UniqueName: \"kubernetes.io/projected/743e187e-782e-427b-8484-5b85f36f6a37-kube-api-access-c5xwl\") pod \"ingress-canary-pwj7j\" (UID: \"743e187e-782e-427b-8484-5b85f36f6a37\") " pod="openshift-ingress-canary/ingress-canary-pwj7j" Oct 30 22:07:46.960397 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960318 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960397 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960355 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30416ea7-1ca2-4983-8de2-5e881a3a9717-host\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.960397 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960373 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-sys-fs\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.960397 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960391 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-kubelet\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960418 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960446 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-system-cni-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960467 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30416ea7-1ca2-4983-8de2-5e881a3a9717-host\") pod \"node-ca-nm8gp\" (UID: \"30416ea7-1ca2-4983-8de2-5e881a3a9717\") " pod="openshift-image-registry/node-ca-nm8gp" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960480 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-system-cni-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960486 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-systemd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960457 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-sys-fs\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960440 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-kubelet\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960512 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960539 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960563 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-system-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960568 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960539 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-systemd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960586 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cnibin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960609 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-modprobe-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960631 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-lib-modules\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960633 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-system-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960653 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-conf\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.960662 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:46.960666 4472 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960676 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-systemd-units\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960698 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-netns\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960723 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-ovn\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960734 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-cnibin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960751 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12bf9532-314f-4f06-a71d-1007aa71b1a3-crio-socket\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960763 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-lib-modules\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960779 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-host\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960791 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-systemd-units\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960809 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd0c97-042f-4a9b-b685-e40d3480ae12-hosts-file\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960812 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-run-ovn\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960818 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-netns\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960764 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-modprobe-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:46.960839 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.460819121 +0000 UTC m=+1.835361654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : secret "metrics-daemon-secret" not found Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960841 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-host\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960874 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-socket-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960891 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/12bf9532-314f-4f06-a71d-1007aa71b1a3-crio-socket\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960896 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/13bd0c97-042f-4a9b-b685-e40d3480ae12-hosts-file\") pod \"node-resolver-kjm85\" (UID: \"13bd0c97-042f-4a9b-b685-e40d3480ae12\") " pod="openshift-dns/node-resolver-kjm85" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960902 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960913 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-socket-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960930 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-conf-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960932 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960948 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-sys\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960978 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-conf-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961016 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-sys\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.960935 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-conf\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961054 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-dbus\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961071 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961086 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysconfig\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961093 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-dbus\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961101 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-var-lib-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961117 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-node-log\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961132 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-systemd\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961147 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961159 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysconfig\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961164 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-var-lib-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961169 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-registration-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961173 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-node-log\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961159 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961188 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-systemd\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961203 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-socket-dir-parent\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961240 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-registration-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961249 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-netns\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961271 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-slash\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961281 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-socket-dir-parent\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961288 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-etc-kubernetes\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961291 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-netns\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961315 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-etc-kubernetes\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961317 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-kubernetes\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961332 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-slash\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961346 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-device-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961369 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-run\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961373 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-kubernetes\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961393 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-device-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961392 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-hostroot\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961416 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961423 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-hostroot\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961425 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-run\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961444 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.961450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961469 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cnibin\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961492 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961517 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:46.961522 4472 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961543 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-k8s-cni-cncf-io\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961572 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-bin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961576 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961581 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-etc-sysctl-d\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961542 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11d96b43-b437-4dbf-92fb-7d21a7fc8060-cnibin\") pod \"multus-additional-cni-plugins-bh6l9\" (UID: \"11d96b43-b437-4dbf-92fb-7d21a7fc8060\") " pod="openshift-multus/multus-additional-cni-plugins-bh6l9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961585 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-k8s-cni-cncf-io\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961599 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-multus-cni-dir\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961602 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961628 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-bin\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961650 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/94271ee8-5df1-4578-af2f-97bba140bd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r7bl4\" (UID: \"94271ee8-5df1-4578-af2f-97bba140bd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r7bl4" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961652 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-log-socket\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:46.961684 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:47.461662486 +0000 UTC m=+1.836205019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961691 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-log-socket\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961708 4472 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961720 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-bin\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961749 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-kubelet\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961775 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-var-lib-kubelet\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961813 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-multus\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961817 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-kubelet\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961818 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-bin\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961838 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b612bcc-424f-40f3-ac06-7403ac235f75-host-slash\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961878 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bf06513-3f43-4d61-9169-1cf2b37a0c64-var-lib-kubelet\") pod \"tuned-hkdv6\" (UID: \"8bf06513-3f43-4d61-9169-1cf2b37a0c64\") " pod="openshift-cluster-node-tuning-operator/tuned-hkdv6" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961884 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-multus-certs\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961884 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-var-lib-cni-multus\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961915 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-kubelet-config\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961921 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b612bcc-424f-40f3-ac06-7403ac235f75-host-slash\") pod \"iptables-alerter-ktczf\" (UID: \"5b612bcc-424f-40f3-ac06-7403ac235f75\") " pod="openshift-network-operator/iptables-alerter-ktczf" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961940 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-etc-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961962 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-netd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.961982 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fae7117e-4b5b-4698-8369-825a1583d108-kubelet-config\") pod \"global-pull-secret-syncer-dfsk2\" (UID: \"fae7117e-4b5b-4698-8369-825a1583d108\") " pod="kube-system/global-pull-secret-syncer-dfsk2" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.962020 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-etc-openvswitch\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.962019 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4217e2e-ad4f-46c8-887c-22ac22d7b6d5-host-cni-netd\") pod \"ovnkube-node-v9p8m\" (UID: \"e4217e2e-ad4f-46c8-887c-22ac22d7b6d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:46.963215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.962045 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9b412a6-23fb-4c4a-91a6-bd60a71a668c-host-run-multus-certs\") pod \"multus-cqvt9\" (UID: \"e9b412a6-23fb-4c4a-91a6-bd60a71a668c\") " pod="openshift-multus/multus-cqvt9" Oct 30 22:07:46.964248 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:46.963907 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3a9929a9-860d-44f5-810c-694da46d6b16-metrics-tls\") pod \"dns-default-tc4nf\" (UID: \"3a9929a9-860d-44f5-810c-694da46d6b16\") " pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:47.056829 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.056799 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:47.389775 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.389751 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tc4nf"] Oct 30 22:07:47.391316 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.391296 4472 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:07:47.465381 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.465339 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:47.465535 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.465412 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:47.465535 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:47.465492 4472 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:47.465619 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:47.465525 4472 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:47.465619 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:47.465560 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:48.46554427 +0000 UTC m=+2.840086804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:47.465619 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:47.465599 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:48.465585431 +0000 UTC m=+2.840127951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : secret "metrics-daemon-secret" not found Oct 30 22:07:47.767017 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.766986 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:47.787393 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:47.787357 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tc4nf" event={"ID":"3a9929a9-860d-44f5-810c-694da46d6b16","Type":"ContainerStarted","Data":"0ba48a63336719f0fe07a67942f3c6ba0b26e85adfe6db4893565b0c150d0ced"} Oct 30 22:07:48.472736 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:48.472700 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:48.472928 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:48.472763 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:48.472928 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:48.472842 4472 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:48.472928 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:48.472853 4472 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 22:07:48.473025 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:48.472933 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs podName:d5e455a3-3e4a-4f60-aba1-0653a30b31f4 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.472912394 +0000 UTC m=+4.847454927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs") pod "network-metrics-daemon-ts8xm" (UID: "d5e455a3-3e4a-4f60-aba1-0653a30b31f4") : secret "metrics-daemon-secret" not found Oct 30 22:07:48.473025 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:48.472957 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:50.472942865 +0000 UTC m=+4.847485381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:49.780925 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:49.780823 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:49.781604 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:49.781100 4472 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 22:07:49.795655 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:49.795626 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tc4nf" event={"ID":"3a9929a9-860d-44f5-810c-694da46d6b16","Type":"ContainerStarted","Data":"0a3001858c6226c8b71aac62ab636ddbb159a41d07f2a313c2e5a66373f7ae8f"} Oct 30 22:07:49.795817 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:49.795679 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tc4nf" event={"ID":"3a9929a9-860d-44f5-810c-694da46d6b16","Type":"ContainerStarted","Data":"2c63c3f158378611e93c637e2d4fb2403339932e1054c7c827b06a62b2adc475"} Oct 30 22:07:49.795817 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:49.795751 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tc4nf" Oct 30 22:07:50.487465 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:50.487424 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:50.487738 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:50.487492 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:50.487738 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:50.487574 4472 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 22:07:50.487738 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:07:50.487642 4472 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls podName:12bf9532-314f-4f06-a71d-1007aa71b1a3 nodeName:}" failed. No retries permitted until 2026-10-30 22:07:54.48762644 +0000 UTC m=+8.862168958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ct89t" (UID: "12bf9532-314f-4f06-a71d-1007aa71b1a3") : secret "insights-runtime-extractor-tls" not found Oct 30 22:07:50.489802 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:50.489780 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5e455a3-3e4a-4f60-aba1-0653a30b31f4-metrics-certs\") pod \"network-metrics-daemon-ts8xm\" (UID: \"d5e455a3-3e4a-4f60-aba1-0653a30b31f4\") " pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:50.656391 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:50.656347 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ts8xm" Oct 30 22:07:50.963824 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:50.963802 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ts8xm"] Oct 30 22:07:50.965938 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:50.965899 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e455a3_3e4a_4f60_aba1_0653a30b31f4.slice/crio-21612833f356e1871c71fbefc8ce53e54550911cfd7fed96a6db5ef440fec0dc WatchSource:0}: Error finding container 21612833f356e1871c71fbefc8ce53e54550911cfd7fed96a6db5ef440fec0dc: Status 404 returned error can't find the container with id 21612833f356e1871c71fbefc8ce53e54550911cfd7fed96a6db5ef440fec0dc Oct 30 22:07:51.803397 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:51.803358 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ts8xm" event={"ID":"d5e455a3-3e4a-4f60-aba1-0653a30b31f4","Type":"ContainerStarted","Data":"21612833f356e1871c71fbefc8ce53e54550911cfd7fed96a6db5ef440fec0dc"} Oct 30 22:07:52.724842 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:52.724806 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9p8m" Oct 30 22:07:52.809019 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:52.808988 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ts8xm" event={"ID":"d5e455a3-3e4a-4f60-aba1-0653a30b31f4","Type":"ContainerStarted","Data":"1afead659d0f0d2db0e7d5e9bbbfb7212744be440da1d1754392fd5a52a523d7"} Oct 30 22:07:52.809190 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:52.809049 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ts8xm" event={"ID":"d5e455a3-3e4a-4f60-aba1-0653a30b31f4","Type":"ContainerStarted","Data":"7406bdc4ba3160e730d0ab5fe040fa503b17a6379d3f572a92013149f81705fb"} Oct 30 22:07:53.943801 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:53.943763 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:07:54.517394 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:54.517353 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:54.519702 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:54.519679 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/12bf9532-314f-4f06-a71d-1007aa71b1a3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ct89t\" (UID: \"12bf9532-314f-4f06-a71d-1007aa71b1a3\") " pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:54.558848 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:54.558810 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ct89t" Oct 30 22:07:54.852671 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:54.852642 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ct89t"] Oct 30 22:07:54.854040 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:07:54.854011 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bf9532_314f_4f06_a71d_1007aa71b1a3.slice/crio-b3e355e9a241eca921274a77f3072a5841f5b0de1f3e0c34f0043ae87858c700 WatchSource:0}: Error finding container b3e355e9a241eca921274a77f3072a5841f5b0de1f3e0c34f0043ae87858c700: Status 404 returned error can't find the container with id b3e355e9a241eca921274a77f3072a5841f5b0de1f3e0c34f0043ae87858c700 Oct 30 22:07:55.819726 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:55.819627 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct89t" event={"ID":"12bf9532-314f-4f06-a71d-1007aa71b1a3","Type":"ContainerStarted","Data":"92d86b96692efb92c0e4285b8d6a1748e0a2fc2da47f90e2b12c55ecb7d8263b"} Oct 30 22:07:55.819726 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:55.819700 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct89t" event={"ID":"12bf9532-314f-4f06-a71d-1007aa71b1a3","Type":"ContainerStarted","Data":"dc65cc3fb2ce27e99ed2901a6a6987ec850725358bb4ad869b63ec281ab5bfc2"} Oct 30 22:07:55.819726 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:55.819722 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct89t" event={"ID":"12bf9532-314f-4f06-a71d-1007aa71b1a3","Type":"ContainerStarted","Data":"b3e355e9a241eca921274a77f3072a5841f5b0de1f3e0c34f0043ae87858c700"} Oct 30 22:07:57.828237 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:57.828184 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ct89t" event={"ID":"12bf9532-314f-4f06-a71d-1007aa71b1a3","Type":"ContainerStarted","Data":"afad12d8aac2b6f12dcdf5b737f0ae9e3032532cc599da7e9aebf26a5ae3683b"} Oct 30 22:07:59.801915 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:07:59.801883 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tc4nf" Oct 30 22:08:01.007142 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.007110 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp"] Oct 30 22:08:01.012405 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.012379 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-cfqxk"] Oct 30 22:08:01.012554 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.012520 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:01.015313 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.015288 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.020628 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.020573 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-69ccfb98cc-h98zg"] Oct 30 22:08:01.023532 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.023510 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.037287 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.037244 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp"] Oct 30 22:08:01.041018 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.040990 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 22:08:01.043492 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.043455 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-cfqxk"] Oct 30 22:08:01.045790 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.045766 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 22:08:01.046668 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.046646 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ccfb98cc-h98zg"] Oct 30 22:08:01.047165 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.047147 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 22:08:01.047258 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.047205 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9f8ql\"" Oct 30 22:08:01.047327 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.047310 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-m9h8l\"" Oct 30 22:08:01.048286 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.048270 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 22:08:01.048550 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.048537 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 22:08:01.048605 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.048561 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 22:08:01.105733 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.105697 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-657b7d784c-mhrnh"] Oct 30 22:08:01.108572 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.108554 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.139451 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.139405 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 22:08:01.139927 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.139907 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 22:08:01.140209 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140166 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 22:08:01.140209 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140179 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 22:08:01.140209 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140191 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-657b7d784c-mhrnh"] Oct 30 22:08:01.140418 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140239 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 22:08:01.140418 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140275 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-d2gfd\"" Oct 30 22:08:01.140418 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140309 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 22:08:01.140418 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.140360 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wkgtq\"" Oct 30 22:08:01.163449 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163410 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/05d3b36c-ab52-431f-9325-f22334a8896d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-6z2jp\" (UID: \"05d3b36c-ab52-431f-9325-f22334a8896d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:01.163449 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163451 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.163652 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163472 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45prg\" (UniqueName: \"kubernetes.io/projected/b5ec06f4-f43a-4de9-ac7c-5ad61065481c-kube-api-access-45prg\") pod \"downloads-6dd789c8b7-cfqxk\" (UID: \"b5ec06f4-f43a-4de9-ac7c-5ad61065481c\") " pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.163652 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163565 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ec06f4-f43a-4de9-ac7c-5ad61065481c-tmp\") pod \"downloads-6dd789c8b7-cfqxk\" (UID: \"b5ec06f4-f43a-4de9-ac7c-5ad61065481c\") " pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.163652 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163645 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p65f\" (UniqueName: \"kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.163743 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163675 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.163743 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163703 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.163802 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163750 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.163833 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163822 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.163946 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.163841 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.264769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.264680 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cd9\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-kube-api-access-h4cd9\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.264769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.264722 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-registry-tls\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.264769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.264743 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3da0545a-84ee-4825-8fba-84d884a3c29d-trusted-ca\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.265006 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.264825 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265006 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.264946 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265006 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.264979 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3da0545a-84ee-4825-8fba-84d884a3c29d-registry-certificates\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.265103 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265009 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265103 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265063 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-bound-sa-token\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.265165 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265104 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265228 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265213 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3da0545a-84ee-4825-8fba-84d884a3c29d-ca-trust-extracted\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.265266 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265249 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265324 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265293 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/05d3b36c-ab52-431f-9325-f22334a8896d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-6z2jp\" (UID: \"05d3b36c-ab52-431f-9325-f22334a8896d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:01.265377 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265352 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3da0545a-84ee-4825-8fba-84d884a3c29d-image-registry-private-configuration\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.265437 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265396 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265437 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265427 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45prg\" (UniqueName: \"kubernetes.io/projected/b5ec06f4-f43a-4de9-ac7c-5ad61065481c-kube-api-access-45prg\") pod \"downloads-6dd789c8b7-cfqxk\" (UID: \"b5ec06f4-f43a-4de9-ac7c-5ad61065481c\") " pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.265528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265459 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ec06f4-f43a-4de9-ac7c-5ad61065481c-tmp\") pod \"downloads-6dd789c8b7-cfqxk\" (UID: \"b5ec06f4-f43a-4de9-ac7c-5ad61065481c\") " pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.265528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265483 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265493 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3da0545a-84ee-4825-8fba-84d884a3c29d-installation-pull-secrets\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.265667 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265541 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p65f\" (UniqueName: \"kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265719 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265672 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.265900 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.265855 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.266078 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.266051 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5ec06f4-f43a-4de9-ac7c-5ad61065481c-tmp\") pod \"downloads-6dd789c8b7-cfqxk\" (UID: \"b5ec06f4-f43a-4de9-ac7c-5ad61065481c\") " pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.266328 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.266304 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.267965 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.267937 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.268075 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.267969 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.268139 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.268089 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/05d3b36c-ab52-431f-9325-f22334a8896d-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-6z2jp\" (UID: \"05d3b36c-ab52-431f-9325-f22334a8896d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:01.294007 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.293977 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p65f\" (UniqueName: \"kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f\") pod \"console-69ccfb98cc-h98zg\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.294148 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.294018 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45prg\" (UniqueName: \"kubernetes.io/projected/b5ec06f4-f43a-4de9-ac7c-5ad61065481c-kube-api-access-45prg\") pod \"downloads-6dd789c8b7-cfqxk\" (UID: \"b5ec06f4-f43a-4de9-ac7c-5ad61065481c\") " pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.325609 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.325570 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:01.331744 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.331717 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:01.343789 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.343763 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:01.366615 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.366554 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3da0545a-84ee-4825-8fba-84d884a3c29d-image-registry-private-configuration\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.366798 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.366777 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3da0545a-84ee-4825-8fba-84d884a3c29d-installation-pull-secrets\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.366823 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cd9\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-kube-api-access-h4cd9\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.366895 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-registry-tls\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.366923 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3da0545a-84ee-4825-8fba-84d884a3c29d-trusted-ca\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.366984 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3da0545a-84ee-4825-8fba-84d884a3c29d-registry-certificates\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.367013 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-bound-sa-token\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.367071 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3da0545a-84ee-4825-8fba-84d884a3c29d-ca-trust-extracted\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.368530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.368260 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3da0545a-84ee-4825-8fba-84d884a3c29d-trusted-ca\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.369003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.368953 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3da0545a-84ee-4825-8fba-84d884a3c29d-ca-trust-extracted\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.369282 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.369251 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3da0545a-84ee-4825-8fba-84d884a3c29d-registry-certificates\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.371463 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.371425 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3da0545a-84ee-4825-8fba-84d884a3c29d-installation-pull-secrets\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.372903 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.372880 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-registry-tls\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.374109 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.374077 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3da0545a-84ee-4825-8fba-84d884a3c29d-image-registry-private-configuration\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.396300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.395704 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-bound-sa-token\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.399556 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.399248 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cd9\" (UniqueName: \"kubernetes.io/projected/3da0545a-84ee-4825-8fba-84d884a3c29d-kube-api-access-h4cd9\") pod \"image-registry-657b7d784c-mhrnh\" (UID: \"3da0545a-84ee-4825-8fba-84d884a3c29d\") " pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.419948 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.419828 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.654039 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.654012 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp"] Oct 30 22:08:01.656094 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:01.656062 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d3b36c_ab52_431f_9325_f22334a8896d.slice/crio-8c6baf87519e5df6b03feeadb3e366f2e0eb8ee9d5d619eedb54442f89c88012 WatchSource:0}: Error finding container 8c6baf87519e5df6b03feeadb3e366f2e0eb8ee9d5d619eedb54442f89c88012: Status 404 returned error can't find the container with id 8c6baf87519e5df6b03feeadb3e366f2e0eb8ee9d5d619eedb54442f89c88012 Oct 30 22:08:01.657131 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.657108 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-cfqxk"] Oct 30 22:08:01.657654 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.657630 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69ccfb98cc-h98zg"] Oct 30 22:08:01.668296 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:01.668260 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ec06f4_f43a_4de9_ac7c_5ad61065481c.slice/crio-321b300d681585da8b01448f164b5134e6fd5d34455f345dd1a38551fdba614f WatchSource:0}: Error finding container 321b300d681585da8b01448f164b5134e6fd5d34455f345dd1a38551fdba614f: Status 404 returned error can't find the container with id 321b300d681585da8b01448f164b5134e6fd5d34455f345dd1a38551fdba614f Oct 30 22:08:01.669130 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:01.669106 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a25676_89ab_4911_83e4_9ac04fa92352.slice/crio-95f12f1cc5c2ac23b6c01179e2c0da9e3a2522dd38ae7f3434c549ff1a963aa1 WatchSource:0}: Error finding container 95f12f1cc5c2ac23b6c01179e2c0da9e3a2522dd38ae7f3434c549ff1a963aa1: Status 404 returned error can't find the container with id 95f12f1cc5c2ac23b6c01179e2c0da9e3a2522dd38ae7f3434c549ff1a963aa1 Oct 30 22:08:01.724567 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.724541 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-657b7d784c-mhrnh"] Oct 30 22:08:01.725054 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.725036 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jxn8m" Oct 30 22:08:01.726019 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:01.725996 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da0545a_84ee_4825_8fba_84d884a3c29d.slice/crio-659eb21c05378f5589e6788a67332ec3dcb2a91ef20764bb414a92ccaeb16a0f WatchSource:0}: Error finding container 659eb21c05378f5589e6788a67332ec3dcb2a91ef20764bb414a92ccaeb16a0f: Status 404 returned error can't find the container with id 659eb21c05378f5589e6788a67332ec3dcb2a91ef20764bb414a92ccaeb16a0f Oct 30 22:08:01.842526 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.842490 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" event={"ID":"3da0545a-84ee-4825-8fba-84d884a3c29d","Type":"ContainerStarted","Data":"11309c60f9f7d4b3006b31b6915dec06742092122a71972f3bb3d746dc0d0c12"} Oct 30 22:08:01.842697 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.842550 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" event={"ID":"3da0545a-84ee-4825-8fba-84d884a3c29d","Type":"ContainerStarted","Data":"659eb21c05378f5589e6788a67332ec3dcb2a91ef20764bb414a92ccaeb16a0f"} Oct 30 22:08:01.842697 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.842575 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:01.843678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.843649 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-cfqxk" event={"ID":"b5ec06f4-f43a-4de9-ac7c-5ad61065481c","Type":"ContainerStarted","Data":"321b300d681585da8b01448f164b5134e6fd5d34455f345dd1a38551fdba614f"} Oct 30 22:08:01.844846 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.844825 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" event={"ID":"05d3b36c-ab52-431f-9325-f22334a8896d","Type":"ContainerStarted","Data":"8c6baf87519e5df6b03feeadb3e366f2e0eb8ee9d5d619eedb54442f89c88012"} Oct 30 22:08:01.845937 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.845919 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ccfb98cc-h98zg" event={"ID":"25a25676-89ab-4911-83e4-9ac04fa92352","Type":"ContainerStarted","Data":"95f12f1cc5c2ac23b6c01179e2c0da9e3a2522dd38ae7f3434c549ff1a963aa1"} Oct 30 22:08:01.890698 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:01.890639 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" podStartSLOduration=0.890625492 podStartE2EDuration="890.625492ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:01.890523278 +0000 UTC m=+16.265065815" watchObservedRunningTime="2026-10-30 22:08:01.890625492 +0000 UTC m=+16.265168029" Oct 30 22:08:03.859417 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:03.859373 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" event={"ID":"05d3b36c-ab52-431f-9325-f22334a8896d","Type":"ContainerStarted","Data":"56832f33727e2ddf97dc8e78ae9bc74d30a01395466ab7af5234140e859bd673"} Oct 30 22:08:03.859951 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:03.859929 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:03.865308 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:03.865286 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" Oct 30 22:08:03.903043 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:03.902976 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-6z2jp" podStartSLOduration=2.651732343 podStartE2EDuration="3.902958229s" totalImagesPullingTime="1.251225886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:03.90277913 +0000 UTC m=+18.277321668" watchObservedRunningTime="2026-10-30 22:08:03.902958229 +0000 UTC m=+18.277500767" Oct 30 22:08:04.490823 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.490791 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x"] Oct 30 22:08:04.499496 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.499466 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.517003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.516932 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x"] Oct 30 22:08:04.528596 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.528566 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Oct 30 22:08:04.529618 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.529591 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Oct 30 22:08:04.529724 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.529651 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cjq8j\"" Oct 30 22:08:04.529910 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.529892 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 22:08:04.530044 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.529957 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 22:08:04.530044 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.529995 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 22:08:04.590769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.590731 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/631044a4-a5ff-45cb-adb6-345f931e72bb-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.590769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.590773 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smzmt\" (UniqueName: \"kubernetes.io/projected/631044a4-a5ff-45cb-adb6-345f931e72bb-kube-api-access-smzmt\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.591047 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.590803 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/631044a4-a5ff-45cb-adb6-345f931e72bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.591047 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.590936 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/631044a4-a5ff-45cb-adb6-345f931e72bb-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.692214 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.692167 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/631044a4-a5ff-45cb-adb6-345f931e72bb-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.692214 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.692213 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smzmt\" (UniqueName: \"kubernetes.io/projected/631044a4-a5ff-45cb-adb6-345f931e72bb-kube-api-access-smzmt\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.692452 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.692267 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/631044a4-a5ff-45cb-adb6-345f931e72bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.692452 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.692312 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/631044a4-a5ff-45cb-adb6-345f931e72bb-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.693031 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.692976 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/631044a4-a5ff-45cb-adb6-345f931e72bb-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.695085 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.695036 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/631044a4-a5ff-45cb-adb6-345f931e72bb-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.695085 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.695054 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/631044a4-a5ff-45cb-adb6-345f931e72bb-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.717637 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.717576 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smzmt\" (UniqueName: \"kubernetes.io/projected/631044a4-a5ff-45cb-adb6-345f931e72bb-kube-api-access-smzmt\") pod \"prometheus-operator-9cd89b74c-wmn6x\" (UID: \"631044a4-a5ff-45cb-adb6-345f931e72bb\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:04.819330 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:04.819258 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" Oct 30 22:08:05.126703 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:05.126645 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x"] Oct 30 22:08:05.129638 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:05.129604 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631044a4_a5ff_45cb_adb6_345f931e72bb.slice/crio-45cc686fee01bf2dc1c8379e5947952db3ffd14c92783dd3da6e2a70eef20f29 WatchSource:0}: Error finding container 45cc686fee01bf2dc1c8379e5947952db3ffd14c92783dd3da6e2a70eef20f29: Status 404 returned error can't find the container with id 45cc686fee01bf2dc1c8379e5947952db3ffd14c92783dd3da6e2a70eef20f29 Oct 30 22:08:05.874213 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:05.874120 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" event={"ID":"631044a4-a5ff-45cb-adb6-345f931e72bb","Type":"ContainerStarted","Data":"45cc686fee01bf2dc1c8379e5947952db3ffd14c92783dd3da6e2a70eef20f29"} Oct 30 22:08:05.876188 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:05.876154 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ccfb98cc-h98zg" event={"ID":"25a25676-89ab-4911-83e4-9ac04fa92352","Type":"ContainerStarted","Data":"5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083"} Oct 30 22:08:05.922563 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:05.922503 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-69ccfb98cc-h98zg" podStartSLOduration=2.76443276 podStartE2EDuration="5.922490385s" totalImagesPullingTime="3.158057625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:05.921405257 +0000 UTC m=+20.295947807" watchObservedRunningTime="2026-10-30 22:08:05.922490385 +0000 UTC m=+20.297032920" Oct 30 22:08:06.882308 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:06.882210 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" event={"ID":"631044a4-a5ff-45cb-adb6-345f931e72bb","Type":"ContainerStarted","Data":"090a710b3f7f7baa6c0d10714f9eaad577916b3a775205d6597cdd98474e9b71"} Oct 30 22:08:06.882308 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:06.882285 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" event={"ID":"631044a4-a5ff-45cb-adb6-345f931e72bb","Type":"ContainerStarted","Data":"8c8570fd7b1714321ee3888fe9883bb1da3e29d4b645d8f6aa13ebe29c8fbf62"} Oct 30 22:08:06.926948 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:06.926886 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-wmn6x" podStartSLOduration=1.609659878 podStartE2EDuration="2.926850151s" totalImagesPullingTime="1.317190273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:06.926453194 +0000 UTC m=+21.300995731" watchObservedRunningTime="2026-10-30 22:08:06.926850151 +0000 UTC m=+21.301392690" Oct 30 22:08:09.206587 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.205791 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fcnqm"] Oct 30 22:08:09.210386 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.210337 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.239707 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.239674 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 22:08:09.239934 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.239909 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t24hw\"" Oct 30 22:08:09.240123 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.240104 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 22:08:09.240210 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.240136 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 22:08:09.328414 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328379 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-textfile\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328580 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328427 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-sys\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328580 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328456 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328580 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328537 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-wtmp\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328731 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328603 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-root\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328731 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328643 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knwjs\" (UniqueName: \"kubernetes.io/projected/6f3f9a41-666d-4192-b269-9da070227251-kube-api-access-knwjs\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328731 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328672 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-tls\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328904 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328751 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.328904 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.328789 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f3f9a41-666d-4192-b269-9da070227251-metrics-client-ca\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430051 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430011 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-textfile\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430075 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-sys\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430105 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430134 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-wtmp\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430159 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-root\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430188 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knwjs\" (UniqueName: \"kubernetes.io/projected/6f3f9a41-666d-4192-b269-9da070227251-kube-api-access-knwjs\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430194 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-sys\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430215 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-tls\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430588 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430262 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430588 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430303 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f3f9a41-666d-4192-b269-9da070227251-metrics-client-ca\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430588 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430345 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-wtmp\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430588 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430405 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-textfile\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430784 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430765 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f3f9a41-666d-4192-b269-9da070227251-root\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430905 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430882 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-accelerators-collector-config\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.430976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.430937 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f3f9a41-666d-4192-b269-9da070227251-metrics-client-ca\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.433272 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.433251 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-tls\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.433454 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.433433 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f3f9a41-666d-4192-b269-9da070227251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.456086 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.456058 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knwjs\" (UniqueName: \"kubernetes.io/projected/6f3f9a41-666d-4192-b269-9da070227251-kube-api-access-knwjs\") pod \"node-exporter-fcnqm\" (UID: \"6f3f9a41-666d-4192-b269-9da070227251\") " pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.526274 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.526203 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fcnqm" Oct 30 22:08:09.539217 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:09.539190 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f3f9a41_666d_4192_b269_9da070227251.slice/crio-96b8b07cc53004c4e1d6ff403608bcd1f1b07b01de31dfe69654025b94bdef27 WatchSource:0}: Error finding container 96b8b07cc53004c4e1d6ff403608bcd1f1b07b01de31dfe69654025b94bdef27: Status 404 returned error can't find the container with id 96b8b07cc53004c4e1d6ff403608bcd1f1b07b01de31dfe69654025b94bdef27 Oct 30 22:08:09.899106 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:09.899070 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcnqm" event={"ID":"6f3f9a41-666d-4192-b269-9da070227251","Type":"ContainerStarted","Data":"96b8b07cc53004c4e1d6ff403608bcd1f1b07b01de31dfe69654025b94bdef27"} Oct 30 22:08:10.905183 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:10.905142 4472 generic.go:356] "Generic (PLEG): container finished" podID="6f3f9a41-666d-4192-b269-9da070227251" containerID="01bc79b2106ab7761195de984720dd85287e823ba375bb849c27ce443ef2be75" exitCode=0 Oct 30 22:08:10.905554 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:10.905217 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcnqm" event={"ID":"6f3f9a41-666d-4192-b269-9da070227251","Type":"ContainerDied","Data":"01bc79b2106ab7761195de984720dd85287e823ba375bb849c27ce443ef2be75"} Oct 30 22:08:11.344012 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.343938 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:11.344012 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.344002 4472 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:11.349297 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.349273 4472 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:11.911218 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.911185 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcnqm" event={"ID":"6f3f9a41-666d-4192-b269-9da070227251","Type":"ContainerStarted","Data":"b059f5e53ad473591e3d0ec2658d4e246a0e6c2f61313099bbf68223ad90e0df"} Oct 30 22:08:11.911661 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.911242 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fcnqm" event={"ID":"6f3f9a41-666d-4192-b269-9da070227251","Type":"ContainerStarted","Data":"7ee9a777289de84ebf93fce8e04ad50cb398ca789a4cd5448e07594cd4321790"} Oct 30 22:08:11.916573 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.916548 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:11.986974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:11.986926 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fcnqm" podStartSLOduration=1.938872836 podStartE2EDuration="2.986913514s" totalImagesPullingTime="966.387001ms" totalInitContainerRuntime="81.653677ms" isStatefulPod=true podCreationTimestamp="2026-10-30 22:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:11.972270704 +0000 UTC m=+26.346813241" watchObservedRunningTime="2026-10-30 22:08:11.986913514 +0000 UTC m=+26.361456046" Oct 30 22:08:13.947217 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:13.947189 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hv7wm" Oct 30 22:08:18.943955 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:18.943854 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-cfqxk" event={"ID":"b5ec06f4-f43a-4de9-ac7c-5ad61065481c","Type":"ContainerStarted","Data":"0498d110cb1436d6cf6d09765b460bc74446b7cc0d4ccf5b560541105a2b7982"} Oct 30 22:08:18.944470 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:18.944274 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:18.954882 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:18.954814 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-cfqxk" Oct 30 22:08:19.018842 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:19.018780 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-cfqxk" podStartSLOduration=2.323060216 podStartE2EDuration="19.01876299s" totalImagesPullingTime="16.695702774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:19.003917132 +0000 UTC m=+33.378459673" watchObservedRunningTime="2026-10-30 22:08:19.01876299 +0000 UTC m=+33.393305525" Oct 30 22:08:19.992793 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:19.992759 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b85577c5-kctz4"] Oct 30 22:08:20.021948 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.021921 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.022201 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.022078 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b85577c5-kctz4"] Oct 30 22:08:20.081523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.081490 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 22:08:20.117772 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.117724 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.117965 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.117795 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9tz\" (UniqueName: \"kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.118701 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.118321 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.118701 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.118397 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.118701 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.118545 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.118701 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.118605 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.118701 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.118692 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.119049 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.118725 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219351 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219308 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219351 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219358 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th9tz\" (UniqueName: \"kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219387 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219410 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219441 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219468 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219527 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.219606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.219552 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.220195 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.220164 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.220301 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.220196 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.220358 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.220321 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.221042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.221021 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.221176 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.221147 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.222327 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.222302 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.223584 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.223564 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.245596 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.245537 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9tz\" (UniqueName: \"kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz\") pod \"console-84b85577c5-kctz4\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.350489 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.350445 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:20.696638 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.696601 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b85577c5-kctz4"] Oct 30 22:08:20.700499 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:20.700472 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4558fab8_4a42_49cf_bc9a_e9f380d6e31e.slice/crio-5cc0b4aac038c4c07b74d3356ce819fb5081b4e01ab469e24edf6cd4e38b998f WatchSource:0}: Error finding container 5cc0b4aac038c4c07b74d3356ce819fb5081b4e01ab469e24edf6cd4e38b998f: Status 404 returned error can't find the container with id 5cc0b4aac038c4c07b74d3356ce819fb5081b4e01ab469e24edf6cd4e38b998f Oct 30 22:08:20.955528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.955420 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b85577c5-kctz4" event={"ID":"4558fab8-4a42-49cf-bc9a-e9f380d6e31e","Type":"ContainerStarted","Data":"d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d"} Oct 30 22:08:20.955528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:20.955472 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b85577c5-kctz4" event={"ID":"4558fab8-4a42-49cf-bc9a-e9f380d6e31e","Type":"ContainerStarted","Data":"5cc0b4aac038c4c07b74d3356ce819fb5081b4e01ab469e24edf6cd4e38b998f"} Oct 30 22:08:21.002423 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:21.002367 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-84b85577c5-kctz4" podStartSLOduration=2.002347847 podStartE2EDuration="2.002347847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:21.001232115 +0000 UTC m=+35.375774654" watchObservedRunningTime="2026-10-30 22:08:21.002347847 +0000 UTC m=+35.376890386" Oct 30 22:08:22.870534 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:22.870501 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-657b7d784c-mhrnh" Oct 30 22:08:26.542344 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:08:26.542311 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:08:30.350647 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:30.350565 4472 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:30.350647 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:30.350621 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:30.355188 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:30.355170 4472 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:31.001140 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:31.001112 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:08:31.083083 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:31.083054 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69ccfb98cc-h98zg"] Oct 30 22:08:47.610788 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.610755 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c6c8988d6-vhshw"] Oct 30 22:08:47.645250 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.645223 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6c8988d6-vhshw"] Oct 30 22:08:47.645396 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.645332 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719380 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719355 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ecbc524-3b52-4e40-94a3-081580ccf798-console-serving-cert\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719512 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719390 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-service-ca\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719512 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719407 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-trusted-ca-bundle\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719597 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719523 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-oauth-serving-cert\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719597 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719560 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ecbc524-3b52-4e40-94a3-081580ccf798-tmp\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719597 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719577 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-console-config\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719753 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719597 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqpzk\" (UniqueName: \"kubernetes.io/projected/4ecbc524-3b52-4e40-94a3-081580ccf798-kube-api-access-mqpzk\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.719753 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.719707 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ecbc524-3b52-4e40-94a3-081580ccf798-console-oauth-config\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820471 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820449 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ecbc524-3b52-4e40-94a3-081580ccf798-tmp\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820610 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820483 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-console-config\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820610 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820512 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqpzk\" (UniqueName: \"kubernetes.io/projected/4ecbc524-3b52-4e40-94a3-081580ccf798-kube-api-access-mqpzk\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820610 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820538 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ecbc524-3b52-4e40-94a3-081580ccf798-console-oauth-config\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820610 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820578 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ecbc524-3b52-4e40-94a3-081580ccf798-console-serving-cert\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820610 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820598 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-service-ca\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820622 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-trusted-ca-bundle\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.820853 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.820684 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-oauth-serving-cert\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.822648 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.821248 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ecbc524-3b52-4e40-94a3-081580ccf798-tmp\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.822648 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.821712 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-console-config\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.822648 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.821877 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-service-ca\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.822648 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.821901 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-oauth-serving-cert\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.824881 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.823529 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ecbc524-3b52-4e40-94a3-081580ccf798-trusted-ca-bundle\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.826464 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.826436 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ecbc524-3b52-4e40-94a3-081580ccf798-console-oauth-config\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.826582 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.826566 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ecbc524-3b52-4e40-94a3-081580ccf798-console-serving-cert\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.845975 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.845957 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqpzk\" (UniqueName: \"kubernetes.io/projected/4ecbc524-3b52-4e40-94a3-081580ccf798-kube-api-access-mqpzk\") pod \"console-7c6c8988d6-vhshw\" (UID: \"4ecbc524-3b52-4e40-94a3-081580ccf798\") " pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:47.970593 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:47.970571 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:48.284218 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:48.284188 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c6c8988d6-vhshw"] Oct 30 22:08:48.285077 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:08:48.285052 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecbc524_3b52_4e40_94a3_081580ccf798.slice/crio-49d70cdb5e97d02661253dbe0ec96fec5deb5a417e3034ac38b75530775e49ad WatchSource:0}: Error finding container 49d70cdb5e97d02661253dbe0ec96fec5deb5a417e3034ac38b75530775e49ad: Status 404 returned error can't find the container with id 49d70cdb5e97d02661253dbe0ec96fec5deb5a417e3034ac38b75530775e49ad Oct 30 22:08:49.055738 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:49.055703 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6c8988d6-vhshw" event={"ID":"4ecbc524-3b52-4e40-94a3-081580ccf798","Type":"ContainerStarted","Data":"dacd782a07503f18a159401f6e2a82a2eaf21837bd4a38b23f10671d280a6a5c"} Oct 30 22:08:49.056132 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:49.055750 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c6c8988d6-vhshw" event={"ID":"4ecbc524-3b52-4e40-94a3-081580ccf798","Type":"ContainerStarted","Data":"49d70cdb5e97d02661253dbe0ec96fec5deb5a417e3034ac38b75530775e49ad"} Oct 30 22:08:49.101291 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:49.101246 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7c6c8988d6-vhshw" podStartSLOduration=2.101233979 podStartE2EDuration="2.101233979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:08:49.101081721 +0000 UTC m=+63.475624258" watchObservedRunningTime="2026-10-30 22:08:49.101233979 +0000 UTC m=+63.475776516" Oct 30 22:08:56.102933 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.102873 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-69ccfb98cc-h98zg" podUID="25a25676-89ab-4911-83e4-9ac04fa92352" containerName="console" containerID="cri-o://5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083" gracePeriod=15 Oct 30 22:08:56.387082 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.387021 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:56.482445 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482413 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp\" (UniqueName: \"kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482445 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482447 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482679 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482488 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482679 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482521 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482679 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482551 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f\" (UniqueName: \"kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482679 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482607 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482679 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482657 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert\") pod \"25a25676-89ab-4911-83e4-9ac04fa92352\" (UID: \"25a25676-89ab-4911-83e4-9ac04fa92352\") " Oct 30 22:08:56.482976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482711 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:08:56.482976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482939 4472 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25a25676-89ab-4911-83e4-9ac04fa92352-tmp\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:56.482976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482958 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:56.483135 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.482968 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:56.483135 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.483041 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:08:56.485175 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.485053 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "kube-api-access-8p65f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:08:56.485175 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.485138 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:08:56.485322 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.485197 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config" pod "25a25676-89ab-4911-83e4-9ac04fa92352" (UID: "25a25676-89ab-4911-83e4-9ac04fa92352"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:08:56.538704 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:08:56.538670 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:08:56.583947 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.583918 4472 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-oauth-serving-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:56.583947 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.583942 4472 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-serving-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:56.583947 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.583952 4472 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-service-ca\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:56.584152 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.583962 4472 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25a25676-89ab-4911-83e4-9ac04fa92352-console-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:56.584152 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.583970 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p65f\" (UniqueName: \"kubernetes.io/projected/25a25676-89ab-4911-83e4-9ac04fa92352-kube-api-access-8p65f\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:56.584152 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:56.583980 4472 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25a25676-89ab-4911-83e4-9ac04fa92352-console-oauth-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:08:57.081948 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.081913 4472 generic.go:356] "Generic (PLEG): container finished" podID="25a25676-89ab-4911-83e4-9ac04fa92352" containerID="5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083" exitCode=0 Oct 30 22:08:57.082138 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.081961 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ccfb98cc-h98zg" event={"ID":"25a25676-89ab-4911-83e4-9ac04fa92352","Type":"ContainerDied","Data":"5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083"} Oct 30 22:08:57.082138 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.081964 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69ccfb98cc-h98zg" Oct 30 22:08:57.082138 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.081998 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69ccfb98cc-h98zg" event={"ID":"25a25676-89ab-4911-83e4-9ac04fa92352","Type":"ContainerDied","Data":"95f12f1cc5c2ac23b6c01179e2c0da9e3a2522dd38ae7f3434c549ff1a963aa1"} Oct 30 22:08:57.082138 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.082017 4472 scope.go:122] "RemoveContainer" containerID="5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083" Oct 30 22:08:57.090940 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.090917 4472 scope.go:122] "RemoveContainer" containerID="5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083" Oct 30 22:08:57.091268 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:08:57.091224 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083\": container with ID starting with 5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083 not found: ID does not exist" containerID="5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083" Oct 30 22:08:57.091322 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.091282 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083"} err="failed to get container status \"5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083\": rpc error: code = NotFound desc = could not find container \"5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083\": container with ID starting with 5d1ff658b2e14352a18f53c979d7ce84df2489309ffdfcd184b80fe1f57e7083 not found: ID does not exist" Oct 30 22:08:57.137176 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.137145 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69ccfb98cc-h98zg"] Oct 30 22:08:57.150577 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.150552 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69ccfb98cc-h98zg"] Oct 30 22:08:57.733568 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.733526 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="25a25676-89ab-4911-83e4-9ac04fa92352" path="/var/lib/kubelet/pods/25a25676-89ab-4911-83e4-9ac04fa92352/volumes" Oct 30 22:08:57.971443 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.971414 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:57.971588 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.971460 4472 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:57.975918 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:57.975899 4472 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:58.090187 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:58.090125 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c6c8988d6-vhshw" Oct 30 22:08:58.167451 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:08:58.167424 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b85577c5-kctz4"] Oct 30 22:09:02.913329 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:02.913295 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-qzm2l-7rzsf"] Oct 30 22:09:02.913819 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:02.913471 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" podUID="5b58fb10-36f9-4a5a-b498-73867672bc21" containerName="insights-gathering" containerID="cri-o://719590205d1e6a96992afb158ada9402e6e12cf2b8eff91280a976579e310b6e" gracePeriod=30 Oct 30 22:09:03.095185 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.095152 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-vjcn6-cc4xd"] Oct 30 22:09:03.096551 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.095581 4472 cpu_manager.go:414] "containerMap: removing container" podUID="25a25676-89ab-4911-83e4-9ac04fa92352" containerName="console" Oct 30 22:09:03.096551 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.095603 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="25a25676-89ab-4911-83e4-9ac04fa92352" containerName="console" Oct 30 22:09:03.096551 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.095669 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="25a25676-89ab-4911-83e4-9ac04fa92352" containerName="console" Oct 30 22:09:03.104250 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.104225 4472 generic.go:356] "Generic (PLEG): container finished" podID="5b58fb10-36f9-4a5a-b498-73867672bc21" containerID="719590205d1e6a96992afb158ada9402e6e12cf2b8eff91280a976579e310b6e" exitCode=2 Oct 30 22:09:03.116870 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.116829 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" event={"ID":"5b58fb10-36f9-4a5a-b498-73867672bc21","Type":"ContainerDied","Data":"719590205d1e6a96992afb158ada9402e6e12cf2b8eff91280a976579e310b6e"} Oct 30 22:09:03.116990 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.116892 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vjcn6-cc4xd"] Oct 30 22:09:03.116990 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.116954 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.188242 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.188195 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:09:03.232480 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.232459 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.232599 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.232488 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.232599 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.232519 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd275\" (UniqueName: \"kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.232599 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.232584 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.333678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.333656 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") pod \"5b58fb10-36f9-4a5a-b498-73867672bc21\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " Oct 30 22:09:03.333794 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.333695 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") pod \"5b58fb10-36f9-4a5a-b498-73867672bc21\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " Oct 30 22:09:03.333794 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.333726 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") pod \"5b58fb10-36f9-4a5a-b498-73867672bc21\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " Oct 30 22:09:03.333943 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.333836 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") pod \"5b58fb10-36f9-4a5a-b498-73867672bc21\" (UID: \"5b58fb10-36f9-4a5a-b498-73867672bc21\") " Oct 30 22:09:03.334000 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.333966 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.334053 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334003 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.334107 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334048 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd275\" (UniqueName: \"kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.334107 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334079 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.334212 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334080 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle" pod "5b58fb10-36f9-4a5a-b498-73867672bc21" (UID: "5b58fb10-36f9-4a5a-b498-73867672bc21"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:03.334212 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334123 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle" pod "5b58fb10-36f9-4a5a-b498-73867672bc21" (UID: "5b58fb10-36f9-4a5a-b498-73867672bc21"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:03.334212 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334167 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path" pod "5b58fb10-36f9-4a5a-b498-73867672bc21" (UID: "5b58fb10-36f9-4a5a-b498-73867672bc21"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:09:03.334212 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334194 4472 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-service-ca-bundle\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:03.334212 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334210 4472 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5b58fb10-36f9-4a5a-b498-73867672bc21-trusted-ca-bundle\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:03.334476 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334402 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.334672 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.334649 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.335042 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.335021 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.336039 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.336019 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl" pod "5b58fb10-36f9-4a5a-b498-73867672bc21" (UID: "5b58fb10-36f9-4a5a-b498-73867672bc21"). InnerVolumeSpecName "kube-api-access-x4nkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:09:03.358955 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.358933 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd275\" (UniqueName: \"kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275\") pod \"periodic-gathering-vjcn6-cc4xd\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.435041 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.435017 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4nkl\" (UniqueName: \"kubernetes.io/projected/5b58fb10-36f9-4a5a-b498-73867672bc21-kube-api-access-x4nkl\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:03.435041 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.435037 4472 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5b58fb10-36f9-4a5a-b498-73867672bc21-archives-path\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:03.442020 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.441979 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:09:03.751992 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:03.751968 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vjcn6-cc4xd"] Oct 30 22:09:03.753720 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:09:03.753692 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe77b02_cc5c_4e86_a373_660e706be87e.slice/crio-6e58151cce4d8c5e91dab9c099038fb9b8d67209fb58659ffa0b813496ce1964 WatchSource:0}: Error finding container 6e58151cce4d8c5e91dab9c099038fb9b8d67209fb58659ffa0b813496ce1964: Status 404 returned error can't find the container with id 6e58151cce4d8c5e91dab9c099038fb9b8d67209fb58659ffa0b813496ce1964 Oct 30 22:09:04.109582 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.109498 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" event={"ID":"5fe77b02-cc5c-4e86-a373-660e706be87e","Type":"ContainerStarted","Data":"1b511e8e21640ffc62c29c7cbc615e1407aa128ae0f7cc7c65985c9572d17e92"} Oct 30 22:09:04.109582 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.109554 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" event={"ID":"5fe77b02-cc5c-4e86-a373-660e706be87e","Type":"ContainerStarted","Data":"6e58151cce4d8c5e91dab9c099038fb9b8d67209fb58659ffa0b813496ce1964"} Oct 30 22:09:04.110848 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.110826 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" Oct 30 22:09:04.110848 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.110834 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-qzm2l-7rzsf" event={"ID":"5b58fb10-36f9-4a5a-b498-73867672bc21","Type":"ContainerDied","Data":"b4a4fbb836d89711c8776474216ab4e171952e7893f41c51016dc27616a91be3"} Oct 30 22:09:04.111071 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.110896 4472 scope.go:122] "RemoveContainer" containerID="719590205d1e6a96992afb158ada9402e6e12cf2b8eff91280a976579e310b6e" Oct 30 22:09:04.152875 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.152817 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" podStartSLOduration=1.152804437 podStartE2EDuration="1.152804437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:09:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:09:04.152078232 +0000 UTC m=+78.526620759" watchObservedRunningTime="2026-10-30 22:09:04.152804437 +0000 UTC m=+78.527346968" Oct 30 22:09:04.189589 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.189560 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-qzm2l-7rzsf"] Oct 30 22:09:04.193971 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:04.193951 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-qzm2l-7rzsf"] Oct 30 22:09:05.733259 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:05.733229 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b58fb10-36f9-4a5a-b498-73867672bc21" path="/var/lib/kubelet/pods/5b58fb10-36f9-4a5a-b498-73867672bc21/volumes" Oct 30 22:09:23.186768 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.186712 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-84b85577c5-kctz4" podUID="4558fab8-4a42-49cf-bc9a-e9f380d6e31e" containerName="console" containerID="cri-o://d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d" gracePeriod=15 Oct 30 22:09:23.421728 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.421705 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:09:23.569524 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569464 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569524 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569505 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp\" (UniqueName: \"kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569706 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569537 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569706 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569589 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569706 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569618 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz\" (UniqueName: \"kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569706 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569643 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569919 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569772 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.569919 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569778 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:09:23.569919 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.569821 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle\") pod \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\" (UID: \"4558fab8-4a42-49cf-bc9a-e9f380d6e31e\") " Oct 30 22:09:23.570082 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.570066 4472 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-tmp\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.570141 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.570110 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:23.570141 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.570120 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:23.570243 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.570158 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:23.570370 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.570352 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:09:23.571606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.571581 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:09:23.571700 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.571664 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:09:23.571739 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.571712 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz" pod "4558fab8-4a42-49cf-bc9a-e9f380d6e31e" (UID: "4558fab8-4a42-49cf-bc9a-e9f380d6e31e"). InnerVolumeSpecName "kube-api-access-th9tz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:09:23.671344 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671317 4472 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-serving-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.671344 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671339 4472 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-oauth-serving-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.671344 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671348 4472 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-service-ca\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.671511 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671356 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th9tz\" (UniqueName: \"kubernetes.io/projected/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-kube-api-access-th9tz\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.671511 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671365 4472 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-oauth-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.671511 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671373 4472 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-console-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:23.671511 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:23.671381 4472 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4558fab8-4a42-49cf-bc9a-e9f380d6e31e-trusted-ca-bundle\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:09:24.179377 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.179341 4472 generic.go:356] "Generic (PLEG): container finished" podID="4558fab8-4a42-49cf-bc9a-e9f380d6e31e" containerID="d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d" exitCode=0 Oct 30 22:09:24.179523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.179391 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b85577c5-kctz4" Oct 30 22:09:24.179523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.179401 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b85577c5-kctz4" event={"ID":"4558fab8-4a42-49cf-bc9a-e9f380d6e31e","Type":"ContainerDied","Data":"d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d"} Oct 30 22:09:24.179523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.179447 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b85577c5-kctz4" event={"ID":"4558fab8-4a42-49cf-bc9a-e9f380d6e31e","Type":"ContainerDied","Data":"5cc0b4aac038c4c07b74d3356ce819fb5081b4e01ab469e24edf6cd4e38b998f"} Oct 30 22:09:24.179523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.179472 4472 scope.go:122] "RemoveContainer" containerID="d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d" Oct 30 22:09:24.186908 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.186889 4472 scope.go:122] "RemoveContainer" containerID="d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d" Oct 30 22:09:24.187225 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:09:24.187208 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d\": container with ID starting with d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d not found: ID does not exist" containerID="d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d" Oct 30 22:09:24.187268 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.187234 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d"} err="failed to get container status \"d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d\": rpc error: code = NotFound desc = could not find container \"d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d\": container with ID starting with d18b54965dd56eb4f401ca8b1eae36954953632b2e933893839f2621e83e7b2d not found: ID does not exist" Oct 30 22:09:24.235739 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.235714 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b85577c5-kctz4"] Oct 30 22:09:24.248912 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:24.248877 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b85577c5-kctz4"] Oct 30 22:09:25.732837 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:09:25.732805 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4558fab8-4a42-49cf-bc9a-e9f380d6e31e" path="/var/lib/kubelet/pods/4558fab8-4a42-49cf-bc9a-e9f380d6e31e/volumes" Oct 30 22:09:26.537480 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:09:26.537448 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:09:56.536428 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:09:56.536394 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:10:26.538921 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:10:26.538827 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:10:27.383274 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:27.383190 4472 generic.go:356] "Generic (PLEG): container finished" podID="5fe77b02-cc5c-4e86-a373-660e706be87e" containerID="1b511e8e21640ffc62c29c7cbc615e1407aa128ae0f7cc7c65985c9572d17e92" exitCode=0 Oct 30 22:10:27.383274 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:27.383253 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" event={"ID":"5fe77b02-cc5c-4e86-a373-660e706be87e","Type":"ContainerDied","Data":"1b511e8e21640ffc62c29c7cbc615e1407aa128ae0f7cc7c65985c9572d17e92"} Oct 30 22:10:28.503536 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.503510 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:10:28.605150 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605116 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle\") pod \"5fe77b02-cc5c-4e86-a373-660e706be87e\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " Oct 30 22:10:28.605312 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605159 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275\" (UniqueName: \"kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275\") pod \"5fe77b02-cc5c-4e86-a373-660e706be87e\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " Oct 30 22:10:28.605312 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605192 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path\") pod \"5fe77b02-cc5c-4e86-a373-660e706be87e\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " Oct 30 22:10:28.605312 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605245 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle\") pod \"5fe77b02-cc5c-4e86-a373-660e706be87e\" (UID: \"5fe77b02-cc5c-4e86-a373-660e706be87e\") " Oct 30 22:10:28.605525 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605503 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle" pod "5fe77b02-cc5c-4e86-a373-660e706be87e" (UID: "5fe77b02-cc5c-4e86-a373-660e706be87e"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:28.605612 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605557 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path" pod "5fe77b02-cc5c-4e86-a373-660e706be87e" (UID: "5fe77b02-cc5c-4e86-a373-660e706be87e"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:10:28.605671 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.605650 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle" pod "5fe77b02-cc5c-4e86-a373-660e706be87e" (UID: "5fe77b02-cc5c-4e86-a373-660e706be87e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:10:28.607318 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.607295 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275" pod "5fe77b02-cc5c-4e86-a373-660e706be87e" (UID: "5fe77b02-cc5c-4e86-a373-660e706be87e"). InnerVolumeSpecName "kube-api-access-rd275". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:10:28.706569 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.706536 4472 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-trusted-ca-bundle\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:10:28.706569 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.706566 4472 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5fe77b02-cc5c-4e86-a373-660e706be87e-service-ca-bundle\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:10:28.706569 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.706574 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd275\" (UniqueName: \"kubernetes.io/projected/5fe77b02-cc5c-4e86-a373-660e706be87e-kube-api-access-rd275\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:10:28.706788 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:28.706584 4472 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/5fe77b02-cc5c-4e86-a373-660e706be87e-archives-path\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:10:29.391483 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:29.391449 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" event={"ID":"5fe77b02-cc5c-4e86-a373-660e706be87e","Type":"ContainerDied","Data":"6e58151cce4d8c5e91dab9c099038fb9b8d67209fb58659ffa0b813496ce1964"} Oct 30 22:10:29.391650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:29.391495 4472 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e58151cce4d8c5e91dab9c099038fb9b8d67209fb58659ffa0b813496ce1964" Oct 30 22:10:29.391650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:10:29.391462 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vjcn6-cc4xd" Oct 30 22:10:56.537927 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:10:56.537888 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:11:26.538221 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:11:26.538184 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:11:56.538098 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:11:56.538063 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:12:26.538242 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:12:26.538206 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:12:56.538465 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:12:56.538429 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:13:26.537685 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:13:26.537607 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:13:56.537631 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:13:56.537590 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:14:26.538022 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:14:26.537987 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:14:56.537785 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:14:56.537749 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:15:26.537971 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:15:26.537933 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:15:56.537571 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:15:56.537533 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:16:26.537633 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:16:26.537552 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:16:48.946276 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946242 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np"] Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946548 4472 cpu_manager.go:414] "containerMap: removing container" podUID="5fe77b02-cc5c-4e86-a373-660e706be87e" containerName="insights-gathering" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946563 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5fe77b02-cc5c-4e86-a373-660e706be87e" containerName="insights-gathering" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946573 4472 cpu_manager.go:414] "containerMap: removing container" podUID="4558fab8-4a42-49cf-bc9a-e9f380d6e31e" containerName="console" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946578 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4558fab8-4a42-49cf-bc9a-e9f380d6e31e" containerName="console" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946593 4472 cpu_manager.go:414] "containerMap: removing container" podUID="5b58fb10-36f9-4a5a-b498-73867672bc21" containerName="insights-gathering" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946598 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b58fb10-36f9-4a5a-b498-73867672bc21" containerName="insights-gathering" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946648 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="5fe77b02-cc5c-4e86-a373-660e706be87e" containerName="insights-gathering" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946655 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="4558fab8-4a42-49cf-bc9a-e9f380d6e31e" containerName="console" Oct 30 22:16:48.946722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.946661 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b58fb10-36f9-4a5a-b498-73867672bc21" containerName="insights-gathering" Oct 30 22:16:48.949319 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.949304 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:48.969278 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.969253 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np"] Oct 30 22:16:48.974054 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.974033 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Oct 30 22:16:48.981299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.981280 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Oct 30 22:16:48.981558 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.981532 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Oct 30 22:16:48.981625 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.981594 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Oct 30 22:16:48.981625 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.981612 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-tp7x7\"" Oct 30 22:16:48.981779 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:48.981756 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Oct 30 22:16:49.042912 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.042883 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8c3b20e3-9ef6-49a0-9629-933b83d9da05-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.043034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.042941 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8c3b20e3-9ef6-49a0-9629-933b83d9da05-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.043074 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.043058 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4g6\" (UniqueName: \"kubernetes.io/projected/8c3b20e3-9ef6-49a0-9629-933b83d9da05-kube-api-access-rj4g6\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.144097 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.144073 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4g6\" (UniqueName: \"kubernetes.io/projected/8c3b20e3-9ef6-49a0-9629-933b83d9da05-kube-api-access-rj4g6\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.144241 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.144110 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8c3b20e3-9ef6-49a0-9629-933b83d9da05-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.144241 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.144154 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8c3b20e3-9ef6-49a0-9629-933b83d9da05-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.144524 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.144505 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8c3b20e3-9ef6-49a0-9629-933b83d9da05-temp-vol\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.146639 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.146615 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8c3b20e3-9ef6-49a0-9629-933b83d9da05-certificates\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.169074 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.169051 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4g6\" (UniqueName: \"kubernetes.io/projected/8c3b20e3-9ef6-49a0-9629-933b83d9da05-kube-api-access-rj4g6\") pod \"keda-metrics-apiserver-86bd856cfb-gq9np\" (UID: \"8c3b20e3-9ef6-49a0-9629-933b83d9da05\") " pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.209407 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.209359 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-rtwp4"] Oct 30 22:16:49.212380 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.212365 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.234203 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.234181 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Oct 30 22:16:49.234998 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.234974 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-rtwp4"] Oct 30 22:16:49.260511 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.260491 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:49.345160 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.345129 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvgj\" (UniqueName: \"kubernetes.io/projected/bdc53456-3590-4716-8af4-f9ec4332b072-kube-api-access-tcvgj\") pod \"keda-admission-7b7c985c58-rtwp4\" (UID: \"bdc53456-3590-4716-8af4-f9ec4332b072\") " pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.345294 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.345179 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bdc53456-3590-4716-8af4-f9ec4332b072-certificates\") pod \"keda-admission-7b7c985c58-rtwp4\" (UID: \"bdc53456-3590-4716-8af4-f9ec4332b072\") " pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.445876 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.445820 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvgj\" (UniqueName: \"kubernetes.io/projected/bdc53456-3590-4716-8af4-f9ec4332b072-kube-api-access-tcvgj\") pod \"keda-admission-7b7c985c58-rtwp4\" (UID: \"bdc53456-3590-4716-8af4-f9ec4332b072\") " pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.446026 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.445890 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bdc53456-3590-4716-8af4-f9ec4332b072-certificates\") pod \"keda-admission-7b7c985c58-rtwp4\" (UID: \"bdc53456-3590-4716-8af4-f9ec4332b072\") " pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.448273 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.448246 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bdc53456-3590-4716-8af4-f9ec4332b072-certificates\") pod \"keda-admission-7b7c985c58-rtwp4\" (UID: \"bdc53456-3590-4716-8af4-f9ec4332b072\") " pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.478393 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.478344 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvgj\" (UniqueName: \"kubernetes.io/projected/bdc53456-3590-4716-8af4-f9ec4332b072-kube-api-access-tcvgj\") pod \"keda-admission-7b7c985c58-rtwp4\" (UID: \"bdc53456-3590-4716-8af4-f9ec4332b072\") " pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.524401 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.524367 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:49.568433 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:16:49.568397 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3b20e3_9ef6_49a0_9629_933b83d9da05.slice/crio-aabf5acde373553ff3366919af97a66299e9bace7ebbea4535360ecd1bb9ffa1 WatchSource:0}: Error finding container aabf5acde373553ff3366919af97a66299e9bace7ebbea4535360ecd1bb9ffa1: Status 404 returned error can't find the container with id aabf5acde373553ff3366919af97a66299e9bace7ebbea4535360ecd1bb9ffa1 Oct 30 22:16:49.570998 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.569013 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np"] Oct 30 22:16:49.570998 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.570135 4472 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:16:49.584727 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.584695 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" event={"ID":"8c3b20e3-9ef6-49a0-9629-933b83d9da05","Type":"ContainerStarted","Data":"aabf5acde373553ff3366919af97a66299e9bace7ebbea4535360ecd1bb9ffa1"} Oct 30 22:16:49.819919 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:49.819892 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-7b7c985c58-rtwp4"] Oct 30 22:16:49.820284 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:16:49.820257 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc53456_3590_4716_8af4_f9ec4332b072.slice/crio-e43a2187bd65b8ce3af2f4be907af0b1c0a7e00ec3028c73e221bd521c19a0fe WatchSource:0}: Error finding container e43a2187bd65b8ce3af2f4be907af0b1c0a7e00ec3028c73e221bd521c19a0fe: Status 404 returned error can't find the container with id e43a2187bd65b8ce3af2f4be907af0b1c0a7e00ec3028c73e221bd521c19a0fe Oct 30 22:16:50.590980 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:50.590942 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" event={"ID":"bdc53456-3590-4716-8af4-f9ec4332b072","Type":"ContainerStarted","Data":"e43a2187bd65b8ce3af2f4be907af0b1c0a7e00ec3028c73e221bd521c19a0fe"} Oct 30 22:16:53.603257 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:53.603217 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" event={"ID":"8c3b20e3-9ef6-49a0-9629-933b83d9da05","Type":"ContainerStarted","Data":"4f8ebb10186607b76eaa60b90a51ab8c8ca9080b9d159622d68bff37e020be9f"} Oct 30 22:16:53.603730 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:53.603431 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:16:53.604953 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:53.604927 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" event={"ID":"bdc53456-3590-4716-8af4-f9ec4332b072","Type":"ContainerStarted","Data":"53cb31c3fbeee3d0cf152f086cbe2373d03c9909011cbe2652b338505e4910f2"} Oct 30 22:16:53.605073 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:53.604970 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:16:53.662924 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:53.662886 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" podStartSLOduration=2.229551461 podStartE2EDuration="5.662876701s" totalImagesPullingTime="3.43332524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:53.662566702 +0000 UTC m=+548.037109239" watchObservedRunningTime="2026-10-30 22:16:53.662876701 +0000 UTC m=+548.037419230" Oct 30 22:16:53.706366 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:16:53.706317 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" podStartSLOduration=1.5910122850000001 podStartE2EDuration="4.706306051s" totalImagesPullingTime="3.115293766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:16:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:16:53.705919474 +0000 UTC m=+548.080462013" watchObservedRunningTime="2026-10-30 22:16:53.706306051 +0000 UTC m=+548.080848590" Oct 30 22:16:56.538338 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:16:56.538301 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:17:04.612671 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:17:04.612641 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-86bd856cfb-gq9np" Oct 30 22:17:14.610166 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:17:14.610138 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-7b7c985c58-rtwp4" Oct 30 22:17:26.538029 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:17:26.537994 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:17:56.538782 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:17:56.538733 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:18:15.659877 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.659833 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-j4p8f"] Oct 30 22:18:15.662880 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.662849 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.682555 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.682529 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-j4p8f"] Oct 30 22:18:15.719518 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.719457 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Oct 30 22:18:15.719518 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.719491 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Oct 30 22:18:15.719832 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.719558 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Oct 30 22:18:15.719832 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.719747 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-54pjn\"" Oct 30 22:18:15.754091 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.754058 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6aeb725f-695a-44c1-8363-146524994e9b-data\") pod \"seaweedfs-78bb9c6ff8-j4p8f\" (UID: \"6aeb725f-695a-44c1-8363-146524994e9b\") " pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.754236 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.754102 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svclm\" (UniqueName: \"kubernetes.io/projected/6aeb725f-695a-44c1-8363-146524994e9b-kube-api-access-svclm\") pod \"seaweedfs-78bb9c6ff8-j4p8f\" (UID: \"6aeb725f-695a-44c1-8363-146524994e9b\") " pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.855074 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.855027 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svclm\" (UniqueName: \"kubernetes.io/projected/6aeb725f-695a-44c1-8363-146524994e9b-kube-api-access-svclm\") pod \"seaweedfs-78bb9c6ff8-j4p8f\" (UID: \"6aeb725f-695a-44c1-8363-146524994e9b\") " pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.855215 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.855139 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6aeb725f-695a-44c1-8363-146524994e9b-data\") pod \"seaweedfs-78bb9c6ff8-j4p8f\" (UID: \"6aeb725f-695a-44c1-8363-146524994e9b\") " pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.855515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.855497 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6aeb725f-695a-44c1-8363-146524994e9b-data\") pod \"seaweedfs-78bb9c6ff8-j4p8f\" (UID: \"6aeb725f-695a-44c1-8363-146524994e9b\") " pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.879977 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.879952 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svclm\" (UniqueName: \"kubernetes.io/projected/6aeb725f-695a-44c1-8363-146524994e9b-kube-api-access-svclm\") pod \"seaweedfs-78bb9c6ff8-j4p8f\" (UID: \"6aeb725f-695a-44c1-8363-146524994e9b\") " pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:15.975707 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:15.975613 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:16.266003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:16.265972 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-78bb9c6ff8-j4p8f"] Oct 30 22:18:16.267446 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:18:16.267420 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aeb725f_695a_44c1_8363_146524994e9b.slice/crio-c775774e9b56f9ee2673b601d2cccf88c6abc43f0f9dbd6046f7a474b01b66d6 WatchSource:0}: Error finding container c775774e9b56f9ee2673b601d2cccf88c6abc43f0f9dbd6046f7a474b01b66d6: Status 404 returned error can't find the container with id c775774e9b56f9ee2673b601d2cccf88c6abc43f0f9dbd6046f7a474b01b66d6 Oct 30 22:18:16.882293 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:16.882247 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" event={"ID":"6aeb725f-695a-44c1-8363-146524994e9b","Type":"ContainerStarted","Data":"c775774e9b56f9ee2673b601d2cccf88c6abc43f0f9dbd6046f7a474b01b66d6"} Oct 30 22:18:19.893747 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:19.893716 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" event={"ID":"6aeb725f-695a-44c1-8363-146524994e9b","Type":"ContainerStarted","Data":"686fbb1ecc293b531d453f8980d99da37feae429d713b44c934022f6ea4cc3e2"} Oct 30 22:18:19.894206 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:19.893874 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:19.937046 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:19.936987 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" podStartSLOduration=2.2887919070000002 podStartE2EDuration="4.936975529s" totalImagesPullingTime="2.648183622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:18:19.936714615 +0000 UTC m=+634.311257135" watchObservedRunningTime="2026-10-30 22:18:19.936975529 +0000 UTC m=+634.311518066" Oct 30 22:18:25.898891 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:18:25.898845 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-78bb9c6ff8-j4p8f" Oct 30 22:18:26.537345 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:18:26.537314 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:18:56.537831 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:18:56.537792 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:19:26.537762 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:19:26.537681 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:19:39.812957 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.812925 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-56ddc4c448-t6ssd"] Oct 30 22:19:39.816232 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.816212 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:39.827530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.827506 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab1e871-2a2a-4dc9-9f35-c78eb3439656-tls-certs\") pod \"model-serving-api-56ddc4c448-t6ssd\" (UID: \"0ab1e871-2a2a-4dc9-9f35-c78eb3439656\") " pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:39.827625 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.827566 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmjpj\" (UniqueName: \"kubernetes.io/projected/0ab1e871-2a2a-4dc9-9f35-c78eb3439656-kube-api-access-mmjpj\") pod \"model-serving-api-56ddc4c448-t6ssd\" (UID: \"0ab1e871-2a2a-4dc9-9f35-c78eb3439656\") " pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:39.835641 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.835616 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-t6ssd"] Oct 30 22:19:39.847732 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.847710 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Oct 30 22:19:39.854251 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.854234 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-vzz2f\"" Oct 30 22:19:39.872159 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.872137 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7f9f8cdc65-xfclj"] Oct 30 22:19:39.875108 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.875094 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:39.894870 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.894833 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7f9f8cdc65-xfclj"] Oct 30 22:19:39.928093 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.928069 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab1e871-2a2a-4dc9-9f35-c78eb3439656-tls-certs\") pod \"model-serving-api-56ddc4c448-t6ssd\" (UID: \"0ab1e871-2a2a-4dc9-9f35-c78eb3439656\") " pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:39.928195 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.928114 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrfsp\" (UniqueName: \"kubernetes.io/projected/24d9f194-d5b8-46ae-8b86-54c52f93fb57-kube-api-access-xrfsp\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:39.928195 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.928133 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24d9f194-d5b8-46ae-8b86-54c52f93fb57-metrics-certs\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:39.928274 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.928219 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmjpj\" (UniqueName: \"kubernetes.io/projected/0ab1e871-2a2a-4dc9-9f35-c78eb3439656-kube-api-access-mmjpj\") pod \"model-serving-api-56ddc4c448-t6ssd\" (UID: \"0ab1e871-2a2a-4dc9-9f35-c78eb3439656\") " pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:39.928274 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.928249 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24d9f194-d5b8-46ae-8b86-54c52f93fb57-cert\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:39.930329 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.930310 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab1e871-2a2a-4dc9-9f35-c78eb3439656-tls-certs\") pod \"model-serving-api-56ddc4c448-t6ssd\" (UID: \"0ab1e871-2a2a-4dc9-9f35-c78eb3439656\") " pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:39.941172 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.941154 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-m4xr2\"" Oct 30 22:19:39.941245 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.941218 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\"" Oct 30 22:19:39.941282 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.941264 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Oct 30 22:19:39.952876 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:39.952841 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmjpj\" (UniqueName: \"kubernetes.io/projected/0ab1e871-2a2a-4dc9-9f35-c78eb3439656-kube-api-access-mmjpj\") pod \"model-serving-api-56ddc4c448-t6ssd\" (UID: \"0ab1e871-2a2a-4dc9-9f35-c78eb3439656\") " pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:40.028741 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.028718 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24d9f194-d5b8-46ae-8b86-54c52f93fb57-cert\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.028900 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.028771 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrfsp\" (UniqueName: \"kubernetes.io/projected/24d9f194-d5b8-46ae-8b86-54c52f93fb57-kube-api-access-xrfsp\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.028900 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.028798 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24d9f194-d5b8-46ae-8b86-54c52f93fb57-metrics-certs\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.030940 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.030919 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24d9f194-d5b8-46ae-8b86-54c52f93fb57-metrics-certs\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.031029 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.031006 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24d9f194-d5b8-46ae-8b86-54c52f93fb57-cert\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.056015 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.055990 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrfsp\" (UniqueName: \"kubernetes.io/projected/24d9f194-d5b8-46ae-8b86-54c52f93fb57-kube-api-access-xrfsp\") pod \"odh-model-controller-7f9f8cdc65-xfclj\" (UID: \"24d9f194-d5b8-46ae-8b86-54c52f93fb57\") " pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.128483 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.128431 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:40.186543 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.186312 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:40.419873 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.419832 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-56ddc4c448-t6ssd"] Oct 30 22:19:40.423415 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:19:40.423134 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab1e871_2a2a_4dc9_9f35_c78eb3439656.slice/crio-33ddae8ecaebfa9812fffa7b472c82b576bd4a7f62be9ed80df56c2cfd1cc5c9 WatchSource:0}: Error finding container 33ddae8ecaebfa9812fffa7b472c82b576bd4a7f62be9ed80df56c2cfd1cc5c9: Status 404 returned error can't find the container with id 33ddae8ecaebfa9812fffa7b472c82b576bd4a7f62be9ed80df56c2cfd1cc5c9 Oct 30 22:19:40.484194 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:40.484174 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7f9f8cdc65-xfclj"] Oct 30 22:19:40.485090 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:19:40.485071 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d9f194_d5b8_46ae_8b86_54c52f93fb57.slice/crio-ad5c8460c8081d1d845b28d66957d80db9f7d4ccee9b07428cb8de0fe4e3a42f WatchSource:0}: Error finding container ad5c8460c8081d1d845b28d66957d80db9f7d4ccee9b07428cb8de0fe4e3a42f: Status 404 returned error can't find the container with id ad5c8460c8081d1d845b28d66957d80db9f7d4ccee9b07428cb8de0fe4e3a42f Oct 30 22:19:41.165139 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:41.165100 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" event={"ID":"24d9f194-d5b8-46ae-8b86-54c52f93fb57","Type":"ContainerStarted","Data":"ad5c8460c8081d1d845b28d66957d80db9f7d4ccee9b07428cb8de0fe4e3a42f"} Oct 30 22:19:41.167286 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:41.167258 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-t6ssd" event={"ID":"0ab1e871-2a2a-4dc9-9f35-c78eb3439656","Type":"ContainerStarted","Data":"33ddae8ecaebfa9812fffa7b472c82b576bd4a7f62be9ed80df56c2cfd1cc5c9"} Oct 30 22:19:43.178304 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:43.178264 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-56ddc4c448-t6ssd" event={"ID":"0ab1e871-2a2a-4dc9-9f35-c78eb3439656","Type":"ContainerStarted","Data":"9f2c132e69601f98bf1aa74131dd2487ff5f0ad6a6dd4aa773ce600769d752ac"} Oct 30 22:19:43.178783 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:43.178395 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:43.222346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:43.222292 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/model-serving-api-56ddc4c448-t6ssd" podStartSLOduration=1.653775965 podStartE2EDuration="4.222274872s" totalImagesPullingTime="2.568498907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:43.221457782 +0000 UTC m=+717.596000331" watchObservedRunningTime="2026-10-30 22:19:43.222274872 +0000 UTC m=+717.596817411" Oct 30 22:19:44.184043 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:44.184007 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" event={"ID":"24d9f194-d5b8-46ae-8b86-54c52f93fb57","Type":"ContainerStarted","Data":"e42e754e36bb8028808e5b6ea51fd94972922b2dcaac3419d4f29a2f4bcb799f"} Oct 30 22:19:44.184463 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:44.184120 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:44.228718 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:44.228659 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" podStartSLOduration=2.430790955 podStartE2EDuration="5.228642702s" totalImagesPullingTime="2.797851747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:19:44.228434525 +0000 UTC m=+718.602977063" watchObservedRunningTime="2026-10-30 22:19:44.228642702 +0000 UTC m=+718.603185243" Oct 30 22:19:54.188975 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:54.188947 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-56ddc4c448-t6ssd" Oct 30 22:19:55.189897 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:19:55.189851 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7f9f8cdc65-xfclj" Oct 30 22:19:56.538430 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:19:56.538394 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:20:26.538439 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:20:26.538404 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:20:56.537708 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:20:56.537676 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:21:26.538136 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:21:26.538098 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:21:32.659173 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.659143 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s"] Oct 30 22:21:32.662396 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.662378 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.697898 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.697840 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Oct 30 22:21:32.698075 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.697955 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"seaweedfs-s3-creds\"" Oct 30 22:21:32.698075 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.698055 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-rollback-predictor-serving-cert\"" Oct 30 22:21:32.698207 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.698168 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"default-dockercfg-7rhfl\"" Oct 30 22:21:32.698268 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.698227 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"openshift-service-ca.crt\"" Oct 30 22:21:32.698268 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.698263 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:21:32.698380 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.698365 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"kube-root-ca.crt\"" Oct 30 22:21:32.699111 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.699091 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s"] Oct 30 22:21:32.729275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.729250 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.729432 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.729301 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qd44\" (UniqueName: \"kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.729432 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.729336 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.729533 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.729442 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.729573 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.729531 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.830746 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.830713 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qd44\" (UniqueName: \"kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.830954 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.830750 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.830954 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.830775 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.830954 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.830794 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.830954 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.830813 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.831289 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.831262 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.831566 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.831543 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.831613 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.831546 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.833150 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.833134 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.856015 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.855989 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qd44\" (UniqueName: \"kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44\") pod \"isvc-canary-rollback-predictor-786f558f5c-ldn6s\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:32.979515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:32.979429 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:33.289378 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:33.289306 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s"] Oct 30 22:21:33.290969 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:21:33.290939 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bec5a4_d77d_4472_be77_04bcb79cd1e4.slice/crio-fa27320ece1ebb228d5efd2fa2beefe5a1ccd42b699810f09f8f4fbc7f250dfc WatchSource:0}: Error finding container fa27320ece1ebb228d5efd2fa2beefe5a1ccd42b699810f09f8f4fbc7f250dfc: Status 404 returned error can't find the container with id fa27320ece1ebb228d5efd2fa2beefe5a1ccd42b699810f09f8f4fbc7f250dfc Oct 30 22:21:33.550713 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:33.550638 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerStarted","Data":"fa27320ece1ebb228d5efd2fa2beefe5a1ccd42b699810f09f8f4fbc7f250dfc"} Oct 30 22:21:37.568125 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:37.568090 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerStarted","Data":"ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee"} Oct 30 22:21:41.583394 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:41.583360 4472 generic.go:356] "Generic (PLEG): container finished" podID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerID="ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee" exitCode=0 Oct 30 22:21:41.583819 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:41.583431 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerDied","Data":"ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee"} Oct 30 22:21:55.424799 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:55.424778 4472 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:21:55.649003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:55.648967 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerStarted","Data":"935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a"} Oct 30 22:21:56.541016 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:21:56.540980 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:21:57.663238 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:57.663198 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerStarted","Data":"cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558"} Oct 30 22:21:57.663698 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:57.663435 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:57.663698 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:57.663493 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:21:57.664644 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:57.664614 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:21:57.737389 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:57.737338 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podStartSLOduration=2.38851475 podStartE2EDuration="25.7373264s" totalImagesPullingTime="19.320530812s" totalInitContainerRuntime="4.028280838s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:21:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:21:57.723744692 +0000 UTC m=+852.098287243" watchObservedRunningTime="2026-10-30 22:21:57.7373264 +0000 UTC m=+852.111868938" Oct 30 22:21:58.666618 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:21:58.666576 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:03.672951 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:03.672923 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:22:03.673564 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:03.673489 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:13.674366 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:13.674325 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:23.674032 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:23.673991 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:26.538596 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:22:26.538553 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:22:33.673563 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:33.673523 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:43.673909 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:43.673848 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:53.673646 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:22:53.673600 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:22:56.538073 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:22:56.538034 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:23:03.673686 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:03.673643 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:23:13.674585 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:13.674559 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:23:26.537753 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:23:26.537715 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:23:50.006273 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.006240 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt"] Oct 30 22:23:50.009521 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.009504 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.039906 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.039854 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:23:50.040037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.040014 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"default-dockercfg-x6ct5\"" Oct 30 22:23:50.040094 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.040044 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:23:50.040094 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.040053 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:23:50.040094 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.040044 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-sklearn-graph-raw-bdc73-predictor-serving-cert\"" Oct 30 22:23:50.040208 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.040099 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-sklearn-graph-raw-bdc73-kube-rbac-proxy-sar-config\"" Oct 30 22:23:50.040208 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.040146 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"openshift-service-ca.crt\"" Oct 30 22:23:50.041886 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.041852 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt"] Oct 30 22:23:50.183341 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.183312 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.183486 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.183363 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.183486 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.183419 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.183486 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.183451 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.183486 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.183467 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltvgp\" (UniqueName: \"kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.283905 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.283826 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.283905 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.283886 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.284108 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.283905 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltvgp\" (UniqueName: \"kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.284108 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.283932 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.284108 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.283973 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.284337 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.284311 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.284599 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.284577 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.284670 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.284647 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.286278 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.286262 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.309203 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.309182 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltvgp\" (UniqueName: \"kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp\") pod \"isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.326050 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.326029 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:50.633167 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:50.633136 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt"] Oct 30 22:23:50.634336 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:23:50.634299 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac81f1bb_0094_4bf5_a1ab_55dbefff1417.slice/crio-8dc3d28bcc1e076dad437867c0663ab0076ec8ddf8551fc4a63e603ccbdfbcb6 WatchSource:0}: Error finding container 8dc3d28bcc1e076dad437867c0663ab0076ec8ddf8551fc4a63e603ccbdfbcb6: Status 404 returned error can't find the container with id 8dc3d28bcc1e076dad437867c0663ab0076ec8ddf8551fc4a63e603ccbdfbcb6 Oct 30 22:23:51.056743 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:51.056712 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerStarted","Data":"10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee"} Oct 30 22:23:51.057133 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:51.056766 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerStarted","Data":"8dc3d28bcc1e076dad437867c0663ab0076ec8ddf8551fc4a63e603ccbdfbcb6"} Oct 30 22:23:55.071528 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:55.071496 4472 generic.go:356] "Generic (PLEG): container finished" podID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerID="10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee" exitCode=0 Oct 30 22:23:55.071913 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:55.071569 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerDied","Data":"10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee"} Oct 30 22:23:56.083020 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:56.082984 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerStarted","Data":"422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6"} Oct 30 22:23:56.083437 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:56.083065 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerStarted","Data":"2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962"} Oct 30 22:23:56.083437 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:56.083334 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:56.083544 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:56.083471 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:23:56.084832 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:56.084798 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:23:56.144248 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:56.144206 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podStartSLOduration=3.44469317 podStartE2EDuration="7.144195311s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.699502141s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:23:56.143138668 +0000 UTC m=+970.517681206" watchObservedRunningTime="2026-10-30 22:23:56.144195311 +0000 UTC m=+970.518737848" Oct 30 22:23:56.538750 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:23:56.538713 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:23:57.086406 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:23:57.086367 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:02.091057 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:02.091029 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:24:02.091531 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:02.091475 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:12.091536 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:12.091496 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:22.091944 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:22.091904 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:26.537563 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:24:26.537518 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:24:32.091795 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:32.091752 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:42.092063 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:42.092023 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:52.092312 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:52.092273 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:24:52.644303 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:52.644271 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s"] Oct 30 22:24:52.644525 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:52.644504 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" containerID="cri-o://935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a" gracePeriod=30 Oct 30 22:24:52.644600 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:52.644560 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kube-rbac-proxy" containerID="cri-o://cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558" gracePeriod=30 Oct 30 22:24:53.286126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:53.286087 4472 generic.go:356] "Generic (PLEG): container finished" podID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerID="cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558" exitCode=0 Oct 30 22:24:53.286492 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:53.286136 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerDied","Data":"cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558"} Oct 30 22:24:53.667247 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:53.667213 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Oct 30 22:24:53.674256 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:53.674223 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Oct 30 22:24:56.537601 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:24:56.537568 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:24:56.985005 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:56.984981 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:24:57.064794 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.064762 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls\" (UniqueName: \"kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls\") pod \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " Oct 30 22:24:57.064949 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.064796 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44\" (UniqueName: \"kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44\") pod \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " Oct 30 22:24:57.064949 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.064828 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location\") pod \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " Oct 30 22:24:57.064949 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.064882 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config\") pod \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " Oct 30 22:24:57.065181 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.064977 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert\") pod \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\" (UID: \"03bec5a4-d77d-4472-be77-04bcb79cd1e4\") " Oct 30 22:24:57.065244 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.065181 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location" pod "03bec5a4-d77d-4472-be77-04bcb79cd1e4" (UID: "03bec5a4-d77d-4472-be77-04bcb79cd1e4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:24:57.065362 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.065318 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config" pod "03bec5a4-d77d-4472-be77-04bcb79cd1e4" (UID: "03bec5a4-d77d-4472-be77-04bcb79cd1e4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:24:57.065582 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.065551 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert" pod "03bec5a4-d77d-4472-be77-04bcb79cd1e4" (UID: "03bec5a4-d77d-4472-be77-04bcb79cd1e4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:24:57.067083 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.067058 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44" pod "03bec5a4-d77d-4472-be77-04bcb79cd1e4" (UID: "03bec5a4-d77d-4472-be77-04bcb79cd1e4"). InnerVolumeSpecName "kube-api-access-5qd44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:24:57.067284 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.067255 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls" pod "03bec5a4-d77d-4472-be77-04bcb79cd1e4" (UID: "03bec5a4-d77d-4472-be77-04bcb79cd1e4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:24:57.166429 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.166406 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:24:57.166429 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.166430 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03bec5a4-d77d-4472-be77-04bcb79cd1e4-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:24:57.166581 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.166439 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qd44\" (UniqueName: \"kubernetes.io/projected/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-api-access-5qd44\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:24:57.166581 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.166448 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:24:57.166581 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.166458 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/03bec5a4-d77d-4472-be77-04bcb79cd1e4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:24:57.301915 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.301883 4472 generic.go:356] "Generic (PLEG): container finished" podID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerID="935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a" exitCode=0 Oct 30 22:24:57.302040 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.301925 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" Oct 30 22:24:57.302040 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.301940 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerDied","Data":"935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a"} Oct 30 22:24:57.302040 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.301995 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s" event={"ID":"03bec5a4-d77d-4472-be77-04bcb79cd1e4","Type":"ContainerDied","Data":"fa27320ece1ebb228d5efd2fa2beefe5a1ccd42b699810f09f8f4fbc7f250dfc"} Oct 30 22:24:57.302040 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.302020 4472 scope.go:122] "RemoveContainer" containerID="cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558" Oct 30 22:24:57.315378 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.315354 4472 scope.go:122] "RemoveContainer" containerID="935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a" Oct 30 22:24:57.322365 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.322350 4472 scope.go:122] "RemoveContainer" containerID="ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee" Oct 30 22:24:57.328772 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.328759 4472 scope.go:122] "RemoveContainer" containerID="cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558" Oct 30 22:24:57.329092 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:24:57.329071 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558\": container with ID starting with cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558 not found: ID does not exist" containerID="cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558" Oct 30 22:24:57.329163 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.329103 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558"} err="failed to get container status \"cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558\": rpc error: code = NotFound desc = could not find container \"cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558\": container with ID starting with cee47e86d5771a3b3018227f0754e535232426d31d11b0fb264f904256212558 not found: ID does not exist" Oct 30 22:24:57.329163 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.329123 4472 scope.go:122] "RemoveContainer" containerID="935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a" Oct 30 22:24:57.329343 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:24:57.329327 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a\": container with ID starting with 935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a not found: ID does not exist" containerID="935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a" Oct 30 22:24:57.329382 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.329347 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a"} err="failed to get container status \"935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a\": rpc error: code = NotFound desc = could not find container \"935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a\": container with ID starting with 935c9b4dc92941105bee5ed7bae3a9fd3ab4d050e69d93b5336fca68facb338a not found: ID does not exist" Oct 30 22:24:57.329382 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.329360 4472 scope.go:122] "RemoveContainer" containerID="ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee" Oct 30 22:24:57.329550 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:24:57.329534 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee\": container with ID starting with ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee not found: ID does not exist" containerID="ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee" Oct 30 22:24:57.329589 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.329553 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee"} err="failed to get container status \"ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee\": rpc error: code = NotFound desc = could not find container \"ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee\": container with ID starting with ac46329ca8e8958d33ce663ce50b095aafc5e427e3662d5f536617911013b9ee not found: ID does not exist" Oct 30 22:24:57.359938 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.359920 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s"] Oct 30 22:24:57.373131 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.373114 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-rollback-predictor-786f558f5c-ldn6s"] Oct 30 22:24:57.732380 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:24:57.732356 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" path="/var/lib/kubelet/pods/03bec5a4-d77d-4472-be77-04bcb79cd1e4/volumes" Oct 30 22:25:00.562556 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.562521 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p"] Oct 30 22:25:00.563034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.562951 4472 cpu_manager.go:414] "containerMap: removing container" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="storage-initializer" Oct 30 22:25:00.563034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.562969 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="storage-initializer" Oct 30 22:25:00.563034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.563001 4472 cpu_manager.go:414] "containerMap: removing container" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kube-rbac-proxy" Oct 30 22:25:00.563034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.563008 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kube-rbac-proxy" Oct 30 22:25:00.563034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.563022 4472 cpu_manager.go:414] "containerMap: removing container" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" Oct 30 22:25:00.563034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.563030 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" Oct 30 22:25:00.563318 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.563115 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kserve-container" Oct 30 22:25:00.563318 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.563128 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="03bec5a4-d77d-4472-be77-04bcb79cd1e4" containerName="kube-rbac-proxy" Oct 30 22:25:00.567877 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.567838 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.584926 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.584906 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"openshift-service-ca.crt\"" Oct 30 22:25:00.584926 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.584913 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:25:00.597923 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.597903 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-stop-kube-rbac-proxy-sar-config\"" Oct 30 22:25:00.598033 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.597972 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"kube-root-ca.crt\"" Oct 30 22:25:00.598098 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.598082 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"seaweedfs-s3-creds\"" Oct 30 22:25:00.598098 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.598085 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"default-dockercfg-7rhfl\"" Oct 30 22:25:00.598181 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.598119 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-stop-predictor-serving-cert\"" Oct 30 22:25:00.599584 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.599564 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p"] Oct 30 22:25:00.691139 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.691109 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.691266 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.691160 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-466np\" (UniqueName: \"kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.691308 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.691274 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.691349 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.691309 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.691349 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.691334 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.792168 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.792136 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.792168 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.792173 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.792419 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.792197 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.792482 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.792454 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-466np\" (UniqueName: \"kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.792558 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.792542 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.792638 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.792614 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.793034 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.793018 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.793124 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.793108 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.794470 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.794453 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.818233 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.818174 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-466np\" (UniqueName: \"kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np\") pod \"isvc-canary-stop-predictor-6bd757b497-g5n5p\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:00.884103 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:00.884056 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:01.198811 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:01.198786 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p"] Oct 30 22:25:01.199632 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:25:01.199611 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedeaf935_18f2_42b3_9014_30a5ad572302.slice/crio-eadbf0074c270d84cf67ab9bb8babde515c8f183f64acd7551118843c0b10576 WatchSource:0}: Error finding container eadbf0074c270d84cf67ab9bb8babde515c8f183f64acd7551118843c0b10576: Status 404 returned error can't find the container with id eadbf0074c270d84cf67ab9bb8babde515c8f183f64acd7551118843c0b10576 Oct 30 22:25:01.319326 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:01.319287 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerStarted","Data":"e3adcb328d7a67ad0590ebf175e61ebbe5379f610e6bb593743ebc79b49f0fa8"} Oct 30 22:25:01.319485 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:01.319358 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerStarted","Data":"eadbf0074c270d84cf67ab9bb8babde515c8f183f64acd7551118843c0b10576"} Oct 30 22:25:02.091570 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:02.091528 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:25:05.336017 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:05.335988 4472 generic.go:356] "Generic (PLEG): container finished" podID="edeaf935-18f2-42b3-9014-30a5ad572302" containerID="e3adcb328d7a67ad0590ebf175e61ebbe5379f610e6bb593743ebc79b49f0fa8" exitCode=0 Oct 30 22:25:05.336439 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:05.336064 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerDied","Data":"e3adcb328d7a67ad0590ebf175e61ebbe5379f610e6bb593743ebc79b49f0fa8"} Oct 30 22:25:06.342169 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:06.342133 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerStarted","Data":"2589f4b5665f1c1e264ef1c72e466fcb5fac7d0f7ca3b52cf4c03887c578c9f2"} Oct 30 22:25:06.342583 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:06.342191 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerStarted","Data":"4bfb4bbc29b508a77dfae7a1036e35085baae8be4174c7007b70012c96de1af4"} Oct 30 22:25:06.342583 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:06.342376 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:06.404975 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:06.404932 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podStartSLOduration=2.484498596 podStartE2EDuration="6.404920032s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.920421436s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:06.403780625 +0000 UTC m=+1040.778323174" watchObservedRunningTime="2026-10-30 22:25:06.404920032 +0000 UTC m=+1040.779462568" Oct 30 22:25:07.346719 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:07.346688 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:07.347830 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:07.347803 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:08.350366 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:08.350331 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:12.091939 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:12.091913 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:25:13.354667 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:13.354640 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:25:13.355118 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:13.355095 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:23.355944 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:23.355905 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:26.537720 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:25:26.537679 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:25:33.355452 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:33.355415 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:40.531902 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:40.531868 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt"] Oct 30 22:25:40.532363 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:40.532162 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" containerID="cri-o://2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962" gracePeriod=30 Oct 30 22:25:40.532363 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:40.532266 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kube-rbac-proxy" containerID="cri-o://422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6" gracePeriod=30 Oct 30 22:25:41.476722 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:41.476684 4472 generic.go:356] "Generic (PLEG): container finished" podID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerID="422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6" exitCode=0 Oct 30 22:25:41.476901 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:41.476751 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerDied","Data":"422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6"} Oct 30 22:25:42.086850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:42.086803 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused" Oct 30 22:25:42.092145 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:42.092121 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Oct 30 22:25:43.355990 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:43.355951 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:44.865850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.865826 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:25:44.890451 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890431 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert\") pod \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " Oct 30 22:25:44.890540 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890518 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config\") pod \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " Oct 30 22:25:44.890577 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890563 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp\" (UniqueName: \"kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp\") pod \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " Oct 30 22:25:44.890633 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890618 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls\") pod \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " Oct 30 22:25:44.890673 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890657 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location\") pod \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\" (UID: \"ac81f1bb-0094-4bf5-a1ab-55dbefff1417\") " Oct 30 22:25:44.890824 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890804 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert" pod "ac81f1bb-0094-4bf5-a1ab-55dbefff1417" (UID: "ac81f1bb-0094-4bf5-a1ab-55dbefff1417"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:44.890904 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890895 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.891002 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890979 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config" pod "ac81f1bb-0094-4bf5-a1ab-55dbefff1417" (UID: "ac81f1bb-0094-4bf5-a1ab-55dbefff1417"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:25:44.891052 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.890989 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location" pod "ac81f1bb-0094-4bf5-a1ab-55dbefff1417" (UID: "ac81f1bb-0094-4bf5-a1ab-55dbefff1417"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:25:44.892678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.892649 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls" pod "ac81f1bb-0094-4bf5-a1ab-55dbefff1417" (UID: "ac81f1bb-0094-4bf5-a1ab-55dbefff1417"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:25:44.892755 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.892683 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp" pod "ac81f1bb-0094-4bf5-a1ab-55dbefff1417" (UID: "ac81f1bb-0094-4bf5-a1ab-55dbefff1417"). InnerVolumeSpecName "kube-api-access-ltvgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:25:44.991906 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.991834 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.991906 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.991855 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltvgp\" (UniqueName: \"kubernetes.io/projected/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kube-api-access-ltvgp\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.991906 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.991880 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:25:44.991906 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:44.991890 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac81f1bb-0094-4bf5-a1ab-55dbefff1417-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:25:45.492594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.492563 4472 generic.go:356] "Generic (PLEG): container finished" podID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerID="2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962" exitCode=0 Oct 30 22:25:45.492755 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.492620 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" Oct 30 22:25:45.492755 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.492644 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerDied","Data":"2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962"} Oct 30 22:25:45.492755 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.492702 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt" event={"ID":"ac81f1bb-0094-4bf5-a1ab-55dbefff1417","Type":"ContainerDied","Data":"8dc3d28bcc1e076dad437867c0663ab0076ec8ddf8551fc4a63e603ccbdfbcb6"} Oct 30 22:25:45.492755 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.492726 4472 scope.go:122] "RemoveContainer" containerID="422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6" Oct 30 22:25:45.501398 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.501382 4472 scope.go:122] "RemoveContainer" containerID="2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962" Oct 30 22:25:45.508295 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.508275 4472 scope.go:122] "RemoveContainer" containerID="10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee" Oct 30 22:25:45.515037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.515019 4472 scope.go:122] "RemoveContainer" containerID="422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6" Oct 30 22:25:45.515300 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:25:45.515259 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6\": container with ID starting with 422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6 not found: ID does not exist" containerID="422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6" Oct 30 22:25:45.515343 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.515309 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6"} err="failed to get container status \"422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6\": rpc error: code = NotFound desc = could not find container \"422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6\": container with ID starting with 422b65789239973ee94016b429f969b5a89a0dd2bc26deafacf82434e64847d6 not found: ID does not exist" Oct 30 22:25:45.515343 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.515327 4472 scope.go:122] "RemoveContainer" containerID="2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962" Oct 30 22:25:45.515562 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:25:45.515545 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962\": container with ID starting with 2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962 not found: ID does not exist" containerID="2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962" Oct 30 22:25:45.515596 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.515570 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962"} err="failed to get container status \"2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962\": rpc error: code = NotFound desc = could not find container \"2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962\": container with ID starting with 2c2160f5db575a87ef6e976340ff6e38da0ef2d3e3a3cf07578e94a6d2439962 not found: ID does not exist" Oct 30 22:25:45.515596 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.515586 4472 scope.go:122] "RemoveContainer" containerID="10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee" Oct 30 22:25:45.515789 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:25:45.515773 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee\": container with ID starting with 10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee not found: ID does not exist" containerID="10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee" Oct 30 22:25:45.515824 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.515795 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee"} err="failed to get container status \"10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee\": rpc error: code = NotFound desc = could not find container \"10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee\": container with ID starting with 10f4fccab2a6841224f9c32d5235ae20bf77aeae3d1e9e1976eccb1a9ef805ee not found: ID does not exist" Oct 30 22:25:45.561816 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.561797 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt"] Oct 30 22:25:45.575369 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.575348 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-bdc73-predictor-849555d596-r7jvt"] Oct 30 22:25:45.732193 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:45.732170 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" path="/var/lib/kubelet/pods/ac81f1bb-0094-4bf5-a1ab-55dbefff1417/volumes" Oct 30 22:25:48.084184 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084151 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7"] Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084434 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kube-rbac-proxy" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084444 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kube-rbac-proxy" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084457 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084462 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084484 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="storage-initializer" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084490 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="storage-initializer" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084533 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kube-rbac-proxy" Oct 30 22:25:48.084541 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.084540 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac81f1bb-0094-4bf5-a1ab-55dbefff1417" containerName="kserve-container" Oct 30 22:25:48.088981 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.088958 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.113774 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.113752 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2zgq\" (UniqueName: \"kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.113883 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.113784 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.113883 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.113808 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.113971 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.113916 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.114008 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.113980 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.118686 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118653 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:25:48.118686 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118671 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"default-dockercfg-x6ct5\"" Oct 30 22:25:48.118820 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118750 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"openshift-service-ca.crt\"" Oct 30 22:25:48.118820 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118763 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-sklearn-graph-raw-hpa-e619c-kube-rbac-proxy-sar-config\"" Oct 30 22:25:48.118820 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118767 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-sklearn-graph-raw-hpa-e619c-predictor-serving-cert\"" Oct 30 22:25:48.118820 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118779 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:25:48.118820 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.118793 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:25:48.120161 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.120143 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7"] Oct 30 22:25:48.214820 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.214792 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2zgq\" (UniqueName: \"kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.214959 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.214829 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.214959 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.214885 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.214959 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.214926 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.215126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.214971 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.215352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.215335 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.215669 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.215649 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.215706 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.215653 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.217192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.217176 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.239585 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.239558 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2zgq\" (UniqueName: \"kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq\") pod \"isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.405255 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.405226 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:48.713250 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:48.713224 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7"] Oct 30 22:25:48.714018 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:25:48.713995 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8bee26d_76dd_48aa_a869_8aabe1331c53.slice/crio-86296bd4bcedab22d6a87bc010b7be987bbe5a9663cc9e296e985cb753dd9d73 WatchSource:0}: Error finding container 86296bd4bcedab22d6a87bc010b7be987bbe5a9663cc9e296e985cb753dd9d73: Status 404 returned error can't find the container with id 86296bd4bcedab22d6a87bc010b7be987bbe5a9663cc9e296e985cb753dd9d73 Oct 30 22:25:49.508262 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:49.508224 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerStarted","Data":"423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806"} Oct 30 22:25:49.508616 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:49.508280 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerStarted","Data":"86296bd4bcedab22d6a87bc010b7be987bbe5a9663cc9e296e985cb753dd9d73"} Oct 30 22:25:53.355522 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:53.355480 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:25:53.523471 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:53.523438 4472 generic.go:356] "Generic (PLEG): container finished" podID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerID="423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806" exitCode=0 Oct 30 22:25:53.523639 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:53.523511 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerDied","Data":"423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806"} Oct 30 22:25:54.528827 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:54.528797 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerStarted","Data":"e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9"} Oct 30 22:25:54.529409 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:54.528874 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerStarted","Data":"73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c"} Oct 30 22:25:54.529409 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:54.529081 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:54.589330 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:54.589289 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podStartSLOduration=2.669862272 podStartE2EDuration="6.589277181s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.919414909s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:54.588685534 +0000 UTC m=+1088.963228070" watchObservedRunningTime="2026-10-30 22:25:54.589277181 +0000 UTC m=+1088.963819717" Oct 30 22:25:55.532835 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:55.532803 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:25:55.534021 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:55.533990 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:25:56.537913 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:25:56.537854 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:25:56.538588 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:25:56.538561 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:26:01.541961 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:01.541930 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:26:01.542405 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:01.542381 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:26:03.355699 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:03.355661 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:26:11.542896 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:11.542845 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:26:13.355819 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:13.355781 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:26:21.542515 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:21.542476 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:26:21.738339 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:21.738314 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:26:26.539996 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:26:26.539956 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:26:30.551139 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:30.551100 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p"] Oct 30 22:26:30.551594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:30.551381 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" containerID="cri-o://4bfb4bbc29b508a77dfae7a1036e35085baae8be4174c7007b70012c96de1af4" gracePeriod=30 Oct 30 22:26:30.551594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:30.551443 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kube-rbac-proxy" containerID="cri-o://2589f4b5665f1c1e264ef1c72e466fcb5fac7d0f7ca3b52cf4c03887c578c9f2" gracePeriod=30 Oct 30 22:26:31.542855 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:31.542814 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:26:31.663546 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:31.663515 4472 generic.go:356] "Generic (PLEG): container finished" podID="edeaf935-18f2-42b3-9014-30a5ad572302" containerID="2589f4b5665f1c1e264ef1c72e466fcb5fac7d0f7ca3b52cf4c03887c578c9f2" exitCode=0 Oct 30 22:26:31.663933 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:31.663568 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerDied","Data":"2589f4b5665f1c1e264ef1c72e466fcb5fac7d0f7ca3b52cf4c03887c578c9f2"} Oct 30 22:26:31.729924 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:31.729890 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.27:8080: connect: connection refused" Oct 30 22:26:33.351621 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:33.351573 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.27:8643/healthz\": dial tcp 10.133.0.27:8643: connect: connection refused" Oct 30 22:26:35.682087 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.682052 4472 generic.go:356] "Generic (PLEG): container finished" podID="edeaf935-18f2-42b3-9014-30a5ad572302" containerID="4bfb4bbc29b508a77dfae7a1036e35085baae8be4174c7007b70012c96de1af4" exitCode=0 Oct 30 22:26:35.682454 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.682102 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerDied","Data":"4bfb4bbc29b508a77dfae7a1036e35085baae8be4174c7007b70012c96de1af4"} Oct 30 22:26:35.888589 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.888565 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:26:35.974961 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.974881 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config\") pod \"edeaf935-18f2-42b3-9014-30a5ad572302\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " Oct 30 22:26:35.974961 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.974927 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert\") pod \"edeaf935-18f2-42b3-9014-30a5ad572302\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " Oct 30 22:26:35.975192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.974963 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location\") pod \"edeaf935-18f2-42b3-9014-30a5ad572302\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " Oct 30 22:26:35.975192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.974983 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls\" (UniqueName: \"kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls\") pod \"edeaf935-18f2-42b3-9014-30a5ad572302\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " Oct 30 22:26:35.975192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.975012 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np\" (UniqueName: \"kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np\") pod \"edeaf935-18f2-42b3-9014-30a5ad572302\" (UID: \"edeaf935-18f2-42b3-9014-30a5ad572302\") " Oct 30 22:26:35.975377 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.975352 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert" pod "edeaf935-18f2-42b3-9014-30a5ad572302" (UID: "edeaf935-18f2-42b3-9014-30a5ad572302"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:35.975434 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.975365 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location" pod "edeaf935-18f2-42b3-9014-30a5ad572302" (UID: "edeaf935-18f2-42b3-9014-30a5ad572302"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:26:35.975434 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.975374 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config" pod "edeaf935-18f2-42b3-9014-30a5ad572302" (UID: "edeaf935-18f2-42b3-9014-30a5ad572302"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:26:35.977177 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.977149 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np" pod "edeaf935-18f2-42b3-9014-30a5ad572302" (UID: "edeaf935-18f2-42b3-9014-30a5ad572302"). InnerVolumeSpecName "kube-api-access-466np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:26:35.977287 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:35.977201 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls" pod "edeaf935-18f2-42b3-9014-30a5ad572302" (UID: "edeaf935-18f2-42b3-9014-30a5ad572302"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:26:36.076126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.076093 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:26:36.076126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.076120 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/edeaf935-18f2-42b3-9014-30a5ad572302-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:26:36.076126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.076130 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/edeaf935-18f2-42b3-9014-30a5ad572302-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:26:36.076386 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.076139 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/edeaf935-18f2-42b3-9014-30a5ad572302-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:26:36.076386 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.076149 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-466np\" (UniqueName: \"kubernetes.io/projected/edeaf935-18f2-42b3-9014-30a5ad572302-kube-api-access-466np\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:26:36.688302 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.688235 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" event={"ID":"edeaf935-18f2-42b3-9014-30a5ad572302","Type":"ContainerDied","Data":"eadbf0074c270d84cf67ab9bb8babde515c8f183f64acd7551118843c0b10576"} Oct 30 22:26:36.688302 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.688273 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p" Oct 30 22:26:36.688804 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.688332 4472 scope.go:122] "RemoveContainer" containerID="2589f4b5665f1c1e264ef1c72e466fcb5fac7d0f7ca3b52cf4c03887c578c9f2" Oct 30 22:26:36.696837 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.696821 4472 scope.go:122] "RemoveContainer" containerID="4bfb4bbc29b508a77dfae7a1036e35085baae8be4174c7007b70012c96de1af4" Oct 30 22:26:36.704099 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.704076 4472 scope.go:122] "RemoveContainer" containerID="e3adcb328d7a67ad0590ebf175e61ebbe5379f610e6bb593743ebc79b49f0fa8" Oct 30 22:26:36.758333 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.758300 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p"] Oct 30 22:26:36.771477 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:36.771447 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-stop-predictor-6bd757b497-g5n5p"] Oct 30 22:26:37.732921 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:37.732885 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" path="/var/lib/kubelet/pods/edeaf935-18f2-42b3-9014-30a5ad572302/volumes" Oct 30 22:26:39.299791 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.299758 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm"] Oct 30 22:26:39.300153 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300089 4472 cpu_manager.go:414] "containerMap: removing container" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="storage-initializer" Oct 30 22:26:39.300153 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300100 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="storage-initializer" Oct 30 22:26:39.300153 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300111 4472 cpu_manager.go:414] "containerMap: removing container" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" Oct 30 22:26:39.300153 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300116 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" Oct 30 22:26:39.300153 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300126 4472 cpu_manager.go:414] "containerMap: removing container" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kube-rbac-proxy" Oct 30 22:26:39.300153 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300131 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kube-rbac-proxy" Oct 30 22:26:39.300389 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300177 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kserve-container" Oct 30 22:26:39.300389 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.300185 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="edeaf935-18f2-42b3-9014-30a5ad572302" containerName="kube-rbac-proxy" Oct 30 22:26:39.304734 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.304713 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.321476 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.321453 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:26:39.321611 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.321529 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"openshift-service-ca.crt\"" Oct 30 22:26:39.321611 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.321549 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-primary-209fd8-kube-rbac-proxy-sar-config\"" Oct 30 22:26:39.321611 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.321579 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"kube-root-ca.crt\"" Oct 30 22:26:39.334792 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.334773 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"seaweedfs-s3-creds\"" Oct 30 22:26:39.334937 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.334813 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"default-dockercfg-7rhfl\"" Oct 30 22:26:39.334937 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.334809 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-primary-209fd8-predictor-serving-cert\"" Oct 30 22:26:39.336663 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.336642 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm"] Oct 30 22:26:39.402850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.402807 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.402850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.402868 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.403136 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.402991 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg2fv\" (UniqueName: \"kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.403136 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.403025 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.403136 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.403097 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.503939 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.503902 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504118 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.503955 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504118 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.503990 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg2fv\" (UniqueName: \"kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504118 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.504007 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504118 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.504029 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504505 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.504479 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504692 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.504674 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.504748 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.504676 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.506476 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.506457 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.529353 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.529321 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg2fv\" (UniqueName: \"kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv\") pod \"isvc-primary-209fd8-predictor-6d545f47c-2ccbm\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.621037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.620953 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:39.929695 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:39.929670 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm"] Oct 30 22:26:39.930745 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:26:39.930713 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d9daec_c712_43e9_a868_f578f3afee5c.slice/crio-d7a6e76a654266f59395fbc16cf5e3db695bc8148c942800967b255ed4621cb1 WatchSource:0}: Error finding container d7a6e76a654266f59395fbc16cf5e3db695bc8148c942800967b255ed4621cb1: Status 404 returned error can't find the container with id d7a6e76a654266f59395fbc16cf5e3db695bc8148c942800967b255ed4621cb1 Oct 30 22:26:40.703494 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:40.703458 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerStarted","Data":"7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89"} Oct 30 22:26:40.703884 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:40.703516 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerStarted","Data":"d7a6e76a654266f59395fbc16cf5e3db695bc8148c942800967b255ed4621cb1"} Oct 30 22:26:41.543198 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:41.543159 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:26:44.721071 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:44.721035 4472 generic.go:356] "Generic (PLEG): container finished" podID="58d9daec-c712-43e9-a868-f578f3afee5c" containerID="7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89" exitCode=0 Oct 30 22:26:44.721447 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:44.721078 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerDied","Data":"7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89"} Oct 30 22:26:45.726491 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:45.726459 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerStarted","Data":"ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d"} Oct 30 22:26:45.726848 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:45.726513 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerStarted","Data":"1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd"} Oct 30 22:26:45.726848 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:45.726815 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:45.726939 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:45.726854 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:45.728091 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:45.728058 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:26:45.788363 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:45.788299 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podStartSLOduration=3.054328217 podStartE2EDuration="6.788286115s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.733957898s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:26:45.787457844 +0000 UTC m=+1140.162000380" watchObservedRunningTime="2026-10-30 22:26:45.788286115 +0000 UTC m=+1140.162828648" Oct 30 22:26:46.730625 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:46.730585 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:26:51.543032 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:51.542992 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:26:51.734804 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:51.734777 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:26:51.735309 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:26:51.735281 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:26:56.538517 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:26:56.538478 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:27:01.543068 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:01.543033 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:27:01.735555 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:01.735517 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:27:11.543644 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:11.543614 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:27:11.735208 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:11.735167 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:27:21.736145 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:21.736113 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:27:26.538131 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:27:26.538090 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:27:31.735250 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:31.735212 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:27:38.773788 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:38.773755 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7"] Oct 30 22:27:38.774275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:38.774004 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" containerID="cri-o://73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c" gracePeriod=30 Oct 30 22:27:38.774275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:38.774102 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kube-rbac-proxy" containerID="cri-o://e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9" gracePeriod=30 Oct 30 22:27:38.916245 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:38.916214 4472 generic.go:356] "Generic (PLEG): container finished" podID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerID="e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9" exitCode=0 Oct 30 22:27:38.916400 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:38.916283 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerDied","Data":"e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9"} Oct 30 22:27:41.538839 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:41.538796 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.28:8643/healthz\": dial tcp 10.133.0.28:8643: connect: connection refused" Oct 30 22:27:41.543147 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:41.543122 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.28:8080: connect: connection refused" Oct 30 22:27:41.735334 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:41.735294 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:27:43.111847 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.111823 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:27:43.181652 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.181623 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls\") pod \"f8bee26d-76dd-48aa-a869-8aabe1331c53\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " Oct 30 22:27:43.181825 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.181659 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq\" (UniqueName: \"kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq\") pod \"f8bee26d-76dd-48aa-a869-8aabe1331c53\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " Oct 30 22:27:43.181825 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.181681 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location\") pod \"f8bee26d-76dd-48aa-a869-8aabe1331c53\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " Oct 30 22:27:43.181825 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.181731 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config\") pod \"f8bee26d-76dd-48aa-a869-8aabe1331c53\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " Oct 30 22:27:43.181825 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.181758 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert\") pod \"f8bee26d-76dd-48aa-a869-8aabe1331c53\" (UID: \"f8bee26d-76dd-48aa-a869-8aabe1331c53\") " Oct 30 22:27:43.182100 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.182068 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location" pod "f8bee26d-76dd-48aa-a869-8aabe1331c53" (UID: "f8bee26d-76dd-48aa-a869-8aabe1331c53"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:27:43.182178 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.182119 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config" pod "f8bee26d-76dd-48aa-a869-8aabe1331c53" (UID: "f8bee26d-76dd-48aa-a869-8aabe1331c53"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:27:43.182380 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.182347 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert" pod "f8bee26d-76dd-48aa-a869-8aabe1331c53" (UID: "f8bee26d-76dd-48aa-a869-8aabe1331c53"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:27:43.183956 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.183925 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq" pod "f8bee26d-76dd-48aa-a869-8aabe1331c53" (UID: "f8bee26d-76dd-48aa-a869-8aabe1331c53"). InnerVolumeSpecName "kube-api-access-p2zgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:27:43.184130 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.184107 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls" pod "f8bee26d-76dd-48aa-a869-8aabe1331c53" (UID: "f8bee26d-76dd-48aa-a869-8aabe1331c53"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:27:43.283192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.283114 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f8bee26d-76dd-48aa-a869-8aabe1331c53-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:27:43.283192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.283153 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2zgq\" (UniqueName: \"kubernetes.io/projected/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-api-access-p2zgq\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:27:43.283192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.283163 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8bee26d-76dd-48aa-a869-8aabe1331c53-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:27:43.283192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.283184 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:27:43.283192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.283195 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f8bee26d-76dd-48aa-a869-8aabe1331c53-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:27:43.936790 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.936757 4472 generic.go:356] "Generic (PLEG): container finished" podID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerID="73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c" exitCode=0 Oct 30 22:27:43.936991 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.936821 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" Oct 30 22:27:43.936991 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.936847 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerDied","Data":"73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c"} Oct 30 22:27:43.936991 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.936929 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7" event={"ID":"f8bee26d-76dd-48aa-a869-8aabe1331c53","Type":"ContainerDied","Data":"86296bd4bcedab22d6a87bc010b7be987bbe5a9663cc9e296e985cb753dd9d73"} Oct 30 22:27:43.936991 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.936957 4472 scope.go:122] "RemoveContainer" containerID="e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9" Oct 30 22:27:43.944690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.944673 4472 scope.go:122] "RemoveContainer" containerID="73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c" Oct 30 22:27:43.953850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.953834 4472 scope.go:122] "RemoveContainer" containerID="423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806" Oct 30 22:27:43.961106 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.961088 4472 scope.go:122] "RemoveContainer" containerID="e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9" Oct 30 22:27:43.961358 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:27:43.961338 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9\": container with ID starting with e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9 not found: ID does not exist" containerID="e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9" Oct 30 22:27:43.961418 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.961366 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9"} err="failed to get container status \"e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9\": rpc error: code = NotFound desc = could not find container \"e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9\": container with ID starting with e737ec2dfa16cf2fbdc6b1507c2448f2483b3f2c14f6ae9359b7a169877f9da9 not found: ID does not exist" Oct 30 22:27:43.961418 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.961383 4472 scope.go:122] "RemoveContainer" containerID="73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c" Oct 30 22:27:43.961628 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:27:43.961609 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c\": container with ID starting with 73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c not found: ID does not exist" containerID="73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c" Oct 30 22:27:43.961674 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.961634 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c"} err="failed to get container status \"73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c\": rpc error: code = NotFound desc = could not find container \"73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c\": container with ID starting with 73ea1cda5f82e3f225668f0f9e8be7d64f211e06e21fbac86b7fc3e3ca8ee06c not found: ID does not exist" Oct 30 22:27:43.961674 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.961647 4472 scope.go:122] "RemoveContainer" containerID="423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806" Oct 30 22:27:43.961880 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:27:43.961849 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806\": container with ID starting with 423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806 not found: ID does not exist" containerID="423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806" Oct 30 22:27:43.961921 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:43.961885 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806"} err="failed to get container status \"423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806\": rpc error: code = NotFound desc = could not find container \"423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806\": container with ID starting with 423586213cc339b76bf166922dec07ae53cd4b8487824054871eb4960fe92806 not found: ID does not exist" Oct 30 22:27:44.006710 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:44.006661 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7"] Oct 30 22:27:44.019945 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:44.019927 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-graph-raw-hpa-e619c-predictor-5685bcf44d-mdss7"] Oct 30 22:27:45.733272 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:45.733244 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" path="/var/lib/kubelet/pods/f8bee26d-76dd-48aa-a869-8aabe1331c53/volumes" Oct 30 22:27:46.257456 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257418 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck"] Oct 30 22:27:46.257739 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257723 4472 cpu_manager.go:414] "containerMap: removing container" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="storage-initializer" Oct 30 22:27:46.257739 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257738 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="storage-initializer" Oct 30 22:27:46.257850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257772 4472 cpu_manager.go:414] "containerMap: removing container" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kube-rbac-proxy" Oct 30 22:27:46.257850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257778 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kube-rbac-proxy" Oct 30 22:27:46.257850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257786 4472 cpu_manager.go:414] "containerMap: removing container" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" Oct 30 22:27:46.257850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257794 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" Oct 30 22:27:46.258062 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257855 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kube-rbac-proxy" Oct 30 22:27:46.258062 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.257875 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8bee26d-76dd-48aa-a869-8aabe1331c53" containerName="kserve-container" Oct 30 22:27:46.262389 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.262370 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.294542 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.294516 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"message-dumper-raw-d0eec-predictor-serving-cert\"" Oct 30 22:27:46.294690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.294585 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:27:46.294690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.294563 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"message-dumper-raw-d0eec-kube-rbac-proxy-sar-config\"" Oct 30 22:27:46.294690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.294632 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"default-dockercfg-x6ct5\"" Oct 30 22:27:46.294690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.294663 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"openshift-service-ca.crt\"" Oct 30 22:27:46.295690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.295672 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck"] Oct 30 22:27:46.409048 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.409015 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.409211 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.409080 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.409211 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.409158 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqhp\" (UniqueName: \"kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.510554 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.510466 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.510554 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.510504 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqhp\" (UniqueName: \"kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.510554 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.510535 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.511220 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.511199 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.512979 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.512957 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.535598 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.535568 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqhp\" (UniqueName: \"kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp\") pod \"message-dumper-raw-d0eec-predictor-79844569d-7k5ck\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.579803 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.579768 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:46.877760 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.877723 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck"] Oct 30 22:27:46.883482 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.883456 4472 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:27:46.948569 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:46.948533 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" event={"ID":"6d53df0d-6304-4d79-90fa-3ad80571b0da","Type":"ContainerStarted","Data":"a154cd23b25fbafdebeca781c181ea8ab97f834474db17e41d04030829d66c95"} Oct 30 22:27:48.956611 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:48.956575 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" event={"ID":"6d53df0d-6304-4d79-90fa-3ad80571b0da","Type":"ContainerStarted","Data":"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f"} Oct 30 22:27:48.957132 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:48.956641 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" event={"ID":"6d53df0d-6304-4d79-90fa-3ad80571b0da","Type":"ContainerStarted","Data":"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c"} Oct 30 22:27:48.957132 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:48.956676 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:48.957132 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:48.956730 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:48.958370 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:48.958356 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:49.003714 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:49.003669 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" podStartSLOduration=1.732159961 podStartE2EDuration="3.003656927s" totalImagesPullingTime="1.271496966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:27:49.002383192 +0000 UTC m=+1203.376925730" watchObservedRunningTime="2026-10-30 22:27:49.003656927 +0000 UTC m=+1203.378199465" Oct 30 22:27:51.735374 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:51.735337 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:27:55.967540 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:27:55.967510 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:27:56.538876 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:27:56.538823 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:28:01.735946 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:01.735871 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:28:26.537820 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:28:26.537785 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:28:40.977501 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:40.977462 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm"] Oct 30 22:28:40.978052 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:40.977701 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" containerID="cri-o://1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd" gracePeriod=30 Oct 30 22:28:40.978052 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:40.977804 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kube-rbac-proxy" containerID="cri-o://ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d" gracePeriod=30 Oct 30 22:28:41.142696 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:41.142659 4472 generic.go:356] "Generic (PLEG): container finished" podID="58d9daec-c712-43e9-a868-f578f3afee5c" containerID="ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d" exitCode=0 Oct 30 22:28:41.142887 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:41.142692 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerDied","Data":"ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d"} Oct 30 22:28:41.731271 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:41.731232 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.29:8643/healthz\": dial tcp 10.133.0.29:8643: connect: connection refused" Oct 30 22:28:41.735744 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:41.735719 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.29:8080: connect: connection refused" Oct 30 22:28:45.714841 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.714816 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:28:45.728171 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728151 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls\" (UniqueName: \"kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls\") pod \"58d9daec-c712-43e9-a868-f578f3afee5c\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " Oct 30 22:28:45.728257 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728196 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config\") pod \"58d9daec-c712-43e9-a868-f578f3afee5c\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " Oct 30 22:28:45.728257 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728252 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert\") pod \"58d9daec-c712-43e9-a868-f578f3afee5c\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " Oct 30 22:28:45.728367 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728289 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location\") pod \"58d9daec-c712-43e9-a868-f578f3afee5c\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " Oct 30 22:28:45.728367 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728316 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv\" (UniqueName: \"kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv\") pod \"58d9daec-c712-43e9-a868-f578f3afee5c\" (UID: \"58d9daec-c712-43e9-a868-f578f3afee5c\") " Oct 30 22:28:45.728655 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728602 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location" pod "58d9daec-c712-43e9-a868-f578f3afee5c" (UID: "58d9daec-c712-43e9-a868-f578f3afee5c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:28:45.728655 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728616 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config" pod "58d9daec-c712-43e9-a868-f578f3afee5c" (UID: "58d9daec-c712-43e9-a868-f578f3afee5c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:28:45.728655 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.728643 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert" pod "58d9daec-c712-43e9-a868-f578f3afee5c" (UID: "58d9daec-c712-43e9-a868-f578f3afee5c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:28:45.730847 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.730807 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls" pod "58d9daec-c712-43e9-a868-f578f3afee5c" (UID: "58d9daec-c712-43e9-a868-f578f3afee5c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:28:45.730847 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.730812 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv" pod "58d9daec-c712-43e9-a868-f578f3afee5c" (UID: "58d9daec-c712-43e9-a868-f578f3afee5c"). InnerVolumeSpecName "kube-api-access-cg2fv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:28:45.829721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.829626 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/58d9daec-c712-43e9-a868-f578f3afee5c-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:28:45.829721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.829660 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg2fv\" (UniqueName: \"kubernetes.io/projected/58d9daec-c712-43e9-a868-f578f3afee5c-kube-api-access-cg2fv\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:28:45.829721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.829675 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/58d9daec-c712-43e9-a868-f578f3afee5c-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:28:45.829721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.829690 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:28:45.829721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:45.829701 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/58d9daec-c712-43e9-a868-f578f3afee5c-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:28:46.168410 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.168371 4472 generic.go:356] "Generic (PLEG): container finished" podID="58d9daec-c712-43e9-a868-f578f3afee5c" containerID="1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd" exitCode=0 Oct 30 22:28:46.168594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.168435 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" Oct 30 22:28:46.168594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.168442 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerDied","Data":"1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd"} Oct 30 22:28:46.168594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.168521 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm" event={"ID":"58d9daec-c712-43e9-a868-f578f3afee5c","Type":"ContainerDied","Data":"d7a6e76a654266f59395fbc16cf5e3db695bc8148c942800967b255ed4621cb1"} Oct 30 22:28:46.168594 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.168547 4472 scope.go:122] "RemoveContainer" containerID="ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d" Oct 30 22:28:46.176331 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.176306 4472 scope.go:122] "RemoveContainer" containerID="1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd" Oct 30 22:28:46.183548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.183519 4472 scope.go:122] "RemoveContainer" containerID="7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89" Oct 30 22:28:46.190702 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.190684 4472 scope.go:122] "RemoveContainer" containerID="ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d" Oct 30 22:28:46.191004 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:28:46.190984 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d\": container with ID starting with ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d not found: ID does not exist" containerID="ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d" Oct 30 22:28:46.191063 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.191015 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d"} err="failed to get container status \"ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d\": rpc error: code = NotFound desc = could not find container \"ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d\": container with ID starting with ce7d835dc8f1d5c0e282b299166c56f95495c5221560f60c81d696dea0fe052d not found: ID does not exist" Oct 30 22:28:46.191063 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.191034 4472 scope.go:122] "RemoveContainer" containerID="1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd" Oct 30 22:28:46.191278 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:28:46.191264 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd\": container with ID starting with 1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd not found: ID does not exist" containerID="1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd" Oct 30 22:28:46.191322 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.191280 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd"} err="failed to get container status \"1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd\": rpc error: code = NotFound desc = could not find container \"1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd\": container with ID starting with 1dc117da5db48e7670b4c985b6a2e01ed3ff7f49259a212165d6cecd9f7ef3bd not found: ID does not exist" Oct 30 22:28:46.191322 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.191292 4472 scope.go:122] "RemoveContainer" containerID="7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89" Oct 30 22:28:46.191547 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:28:46.191529 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89\": container with ID starting with 7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89 not found: ID does not exist" containerID="7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89" Oct 30 22:28:46.191583 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.191554 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89"} err="failed to get container status \"7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89\": rpc error: code = NotFound desc = could not find container \"7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89\": container with ID starting with 7c2d09a7906eac71e1e8b27b5f055d96078987e19842adcdbfa7567cc8084c89 not found: ID does not exist" Oct 30 22:28:46.225306 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.225271 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm"] Oct 30 22:28:46.238484 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:46.238444 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-primary-209fd8-predictor-6d545f47c-2ccbm"] Oct 30 22:28:47.733041 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:28:47.733005 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" path="/var/lib/kubelet/pods/58d9daec-c712-43e9-a868-f578f3afee5c/volumes" Oct 30 22:28:56.537271 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:28:56.537234 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:29:26.539242 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:29:26.539202 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:29:31.848137 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:31.848104 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw1-2951e75f13_message-dumper-raw-d0eec-predictor-79844569d-7k5ck_6d53df0d-6304-4d79-90fa-3ad80571b0da/kserve-container/0.log" Oct 30 22:29:32.542657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.542625 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck"] Oct 30 22:29:32.542916 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.542888 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kserve-container" containerID="cri-o://8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c" gracePeriod=30 Oct 30 22:29:32.543039 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.542937 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kube-rbac-proxy" containerID="cri-o://efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f" gracePeriod=30 Oct 30 22:29:32.784924 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.784898 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:29:32.891428 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.891406 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls\") pod \"6d53df0d-6304-4d79-90fa-3ad80571b0da\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " Oct 30 22:29:32.891748 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.891511 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config\") pod \"6d53df0d-6304-4d79-90fa-3ad80571b0da\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " Oct 30 22:29:32.891748 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.891536 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp\" (UniqueName: \"kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp\") pod \"6d53df0d-6304-4d79-90fa-3ad80571b0da\" (UID: \"6d53df0d-6304-4d79-90fa-3ad80571b0da\") " Oct 30 22:29:32.891905 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.891839 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config" pod "6d53df0d-6304-4d79-90fa-3ad80571b0da" (UID: "6d53df0d-6304-4d79-90fa-3ad80571b0da"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:29:32.893323 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.893298 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls" pod "6d53df0d-6304-4d79-90fa-3ad80571b0da" (UID: "6d53df0d-6304-4d79-90fa-3ad80571b0da"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:29:32.893529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.893508 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp" pod "6d53df0d-6304-4d79-90fa-3ad80571b0da" (UID: "6d53df0d-6304-4d79-90fa-3ad80571b0da"). InnerVolumeSpecName "kube-api-access-9hqhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:29:32.992365 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.992343 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d53df0d-6304-4d79-90fa-3ad80571b0da-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:29:32.992365 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.992363 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:29:32.992499 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:32.992372 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hqhp\" (UniqueName: \"kubernetes.io/projected/6d53df0d-6304-4d79-90fa-3ad80571b0da-kube-api-access-9hqhp\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:29:33.339300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339223 4472 generic.go:356] "Generic (PLEG): container finished" podID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerID="efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f" exitCode=0 Oct 30 22:29:33.339300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339247 4472 generic.go:356] "Generic (PLEG): container finished" podID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerID="8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c" exitCode=2 Oct 30 22:29:33.339300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339282 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" Oct 30 22:29:33.339300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339289 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" event={"ID":"6d53df0d-6304-4d79-90fa-3ad80571b0da","Type":"ContainerDied","Data":"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f"} Oct 30 22:29:33.339590 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339334 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" event={"ID":"6d53df0d-6304-4d79-90fa-3ad80571b0da","Type":"ContainerDied","Data":"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c"} Oct 30 22:29:33.339590 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339354 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck" event={"ID":"6d53df0d-6304-4d79-90fa-3ad80571b0da","Type":"ContainerDied","Data":"a154cd23b25fbafdebeca781c181ea8ab97f834474db17e41d04030829d66c95"} Oct 30 22:29:33.339590 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.339377 4472 scope.go:122] "RemoveContainer" containerID="efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f" Oct 30 22:29:33.347603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.347522 4472 scope.go:122] "RemoveContainer" containerID="8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c" Oct 30 22:29:33.354551 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.354530 4472 scope.go:122] "RemoveContainer" containerID="efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f" Oct 30 22:29:33.354806 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:29:33.354787 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f\": container with ID starting with efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f not found: ID does not exist" containerID="efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f" Oct 30 22:29:33.354841 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.354816 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f"} err="failed to get container status \"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f\": rpc error: code = NotFound desc = could not find container \"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f\": container with ID starting with efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f not found: ID does not exist" Oct 30 22:29:33.354841 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.354834 4472 scope.go:122] "RemoveContainer" containerID="8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c" Oct 30 22:29:33.355130 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:29:33.355109 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c\": container with ID starting with 8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c not found: ID does not exist" containerID="8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c" Oct 30 22:29:33.355229 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.355139 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c"} err="failed to get container status \"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c\": rpc error: code = NotFound desc = could not find container \"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c\": container with ID starting with 8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c not found: ID does not exist" Oct 30 22:29:33.355229 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.355201 4472 scope.go:122] "RemoveContainer" containerID="efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f" Oct 30 22:29:33.355488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.355466 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f"} err="failed to get container status \"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f\": rpc error: code = NotFound desc = could not find container \"efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f\": container with ID starting with efa79350adcb1f83de97e637b65a930972790e9bccb2af4ee2887f87892b1f2f not found: ID does not exist" Oct 30 22:29:33.355488 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.355487 4472 scope.go:122] "RemoveContainer" containerID="8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c" Oct 30 22:29:33.355685 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.355667 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c"} err="failed to get container status \"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c\": rpc error: code = NotFound desc = could not find container \"8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c\": container with ID starting with 8f38a64dec0804227b157fad4bc385f56c4db313b9f0bbbd46db18aca113831c not found: ID does not exist" Oct 30 22:29:33.394244 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.394217 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck"] Oct 30 22:29:33.407288 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.407265 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/message-dumper-raw-d0eec-predictor-79844569d-7k5ck"] Oct 30 22:29:33.732733 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:29:33.732705 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" path="/var/lib/kubelet/pods/6d53df0d-6304-4d79-90fa-3ad80571b0da/volumes" Oct 30 22:29:56.540470 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:29:56.540430 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:30:04.537162 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537127 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h"] Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537398 4472 cpu_manager.go:414] "containerMap: removing container" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kserve-container" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537409 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kserve-container" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537419 4472 cpu_manager.go:414] "containerMap: removing container" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537424 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537438 4472 cpu_manager.go:414] "containerMap: removing container" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kube-rbac-proxy" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537443 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kube-rbac-proxy" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537457 4472 cpu_manager.go:414] "containerMap: removing container" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kube-rbac-proxy" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537462 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kube-rbac-proxy" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537469 4472 cpu_manager.go:414] "containerMap: removing container" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="storage-initializer" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537474 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="storage-initializer" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537517 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kserve-container" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537524 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kserve-container" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537530 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="58d9daec-c712-43e9-a868-f578f3afee5c" containerName="kube-rbac-proxy" Oct 30 22:30:04.537603 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.537537 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d53df0d-6304-4d79-90fa-3ad80571b0da" containerName="kube-rbac-proxy" Oct 30 22:30:04.541907 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.541890 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.574068 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574040 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:30:04.574068 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574058 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"kube-root-ca.crt\"" Oct 30 22:30:04.574299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574043 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"seaweedfs-s3-creds\"" Oct 30 22:30:04.574299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574066 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-sklearn-scale-raw-d9aaf-kube-rbac-proxy-sar-config\"" Oct 30 22:30:04.574299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574121 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"default-dockercfg-x6ct5\"" Oct 30 22:30:04.574299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574152 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw1-2951e75f13\"/\"openshift-service-ca.crt\"" Oct 30 22:30:04.574299 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.574214 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw1-2951e75f13\"/\"isvc-sklearn-scale-raw-d9aaf-predictor-serving-cert\"" Oct 30 22:30:04.575414 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.575399 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h"] Oct 30 22:30:04.719976 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.719948 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx8zp\" (UniqueName: \"kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.720133 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.720024 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.720133 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.720049 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.720133 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.720074 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.720255 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.720175 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.820834 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.820773 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx8zp\" (UniqueName: \"kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.820834 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.820807 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.820834 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.820823 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.821095 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.820848 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.821095 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.820986 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.821222 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.821203 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.821591 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.821571 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.821675 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.821572 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.823203 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.823184 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.845850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.845828 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx8zp\" (UniqueName: \"kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp\") pod \"isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:04.857608 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:04.857588 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:05.164920 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:05.164891 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h"] Oct 30 22:30:05.166062 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:30:05.166025 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59396fcd_13fb_4be4_b78e_d7fcdacb00c8.slice/crio-3337ad2668d7e64ed0308f2e1c1596fdcb986c726d05114cb16c49f3fb1d5297 WatchSource:0}: Error finding container 3337ad2668d7e64ed0308f2e1c1596fdcb986c726d05114cb16c49f3fb1d5297: Status 404 returned error can't find the container with id 3337ad2668d7e64ed0308f2e1c1596fdcb986c726d05114cb16c49f3fb1d5297 Oct 30 22:30:05.453519 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:05.453423 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerStarted","Data":"20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a"} Oct 30 22:30:05.453519 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:05.453509 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerStarted","Data":"3337ad2668d7e64ed0308f2e1c1596fdcb986c726d05114cb16c49f3fb1d5297"} Oct 30 22:30:09.468847 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:09.468767 4472 generic.go:356] "Generic (PLEG): container finished" podID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerID="20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a" exitCode=0 Oct 30 22:30:09.468847 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:09.468835 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerDied","Data":"20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a"} Oct 30 22:30:10.474100 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:10.474061 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerStarted","Data":"69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7"} Oct 30 22:30:10.474478 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:10.474126 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerStarted","Data":"8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace"} Oct 30 22:30:10.474478 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:10.474324 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:10.537391 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:10.537345 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podStartSLOduration=2.576033704 podStartE2EDuration="6.537332862s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.961299158s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:10.535691441 +0000 UTC m=+1344.910233979" watchObservedRunningTime="2026-10-30 22:30:10.537332862 +0000 UTC m=+1344.911875401" Oct 30 22:30:11.478021 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:11.477989 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:11.479053 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:11.479030 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:30:12.480843 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:12.480805 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:30:17.485807 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:17.485776 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:30:17.486348 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:17.486322 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:30:26.538490 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:30:26.538450 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:30:27.486410 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:27.486373 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:30:37.486604 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:37.486564 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:30:47.486981 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:47.486943 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:30:56.537848 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:30:56.537812 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:30:57.486439 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:30:57.486402 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:07.486587 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:31:07.486545 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:17.486365 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:31:17.486323 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:26.537994 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:31:26.537951 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:31:27.487081 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:31:27.487038 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:37.486694 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:31:37.486655 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:41.729322 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:31:41.729273 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:51.729752 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:31:51.729707 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:31:56.537604 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:31:56.537568 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:32:01.729928 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:01.729882 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:32:11.729900 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:11.729843 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:32:21.729192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:21.729144 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:32:23.376553 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.376512 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p"] Oct 30 22:32:23.380101 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.380084 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.404962 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.404932 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p"] Oct 30 22:32:23.426793 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.426765 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.426985 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.426798 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.426985 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.426836 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.426985 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.426964 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.427144 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.427048 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m25nm\" (UniqueName: \"kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.478054 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.477996 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-create-kube-rbac-proxy-sar-config\"" Oct 30 22:32:23.478054 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.477996 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:32:23.478054 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.477996 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"seaweedfs-s3-creds\"" Oct 30 22:32:23.478307 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.478043 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"kube-root-ca.crt\"" Oct 30 22:32:23.478307 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.478137 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"openshift-service-ca.crt\"" Oct 30 22:32:23.478307 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.478137 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"default-dockercfg-7rhfl\"" Oct 30 22:32:23.478307 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.478146 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-create-predictor-serving-cert\"" Oct 30 22:32:23.528283 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.528249 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.528283 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.528283 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.528500 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.528321 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m25nm\" (UniqueName: \"kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.528500 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.528342 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.528500 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.528357 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.528824 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.528800 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.529149 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.529128 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.529149 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.529139 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.530678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.530655 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.560663 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.560629 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m25nm\" (UniqueName: \"kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm\") pod \"isvc-canary-create-predictor-54d47cbf97-sts9p\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:23.697341 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:23.697307 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:24.006948 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:24.006921 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p"] Oct 30 22:32:24.007774 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:32:24.007749 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba08327a_9585_4a4e_b9b0_b55e889a1860.slice/crio-5ca1e9b0906f04b118d6747f808505a0d55fadc7b6142f0f9722f24d079ad65f WatchSource:0}: Error finding container 5ca1e9b0906f04b118d6747f808505a0d55fadc7b6142f0f9722f24d079ad65f: Status 404 returned error can't find the container with id 5ca1e9b0906f04b118d6747f808505a0d55fadc7b6142f0f9722f24d079ad65f Oct 30 22:32:24.937336 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:24.937293 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerStarted","Data":"ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a"} Oct 30 22:32:24.937764 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:24.937352 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerStarted","Data":"5ca1e9b0906f04b118d6747f808505a0d55fadc7b6142f0f9722f24d079ad65f"} Oct 30 22:32:26.538109 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:32:26.538063 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:32:27.949529 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:27.949497 4472 generic.go:356] "Generic (PLEG): container finished" podID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerID="ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a" exitCode=0 Oct 30 22:32:27.949817 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:27.949565 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerDied","Data":"ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a"} Oct 30 22:32:28.955560 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:28.955522 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerStarted","Data":"aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665"} Oct 30 22:32:28.956048 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:28.955592 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerStarted","Data":"eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06"} Oct 30 22:32:28.956048 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:28.955855 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:29.029110 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:29.029051 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podStartSLOduration=2.155281382 podStartE2EDuration="6.029037389s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.873756007s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:32:29.015743068 +0000 UTC m=+1483.390285606" watchObservedRunningTime="2026-10-30 22:32:29.029037389 +0000 UTC m=+1483.403579927" Oct 30 22:32:29.959045 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:29.959017 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:29.960219 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:29.960191 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:32:30.962782 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:30.962744 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:32:31.729440 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:31.729397 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:32:35.967413 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:35.967381 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:32:35.969750 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:35.968000 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:32:41.730003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:41.729954 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:32:45.968183 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:45.968141 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:32:51.733082 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:51.733049 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:32:55.968029 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:55.967990 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:32:55.991706 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:55.991673 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h"] Oct 30 22:32:55.991994 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:55.991938 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" containerID="cri-o://8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace" gracePeriod=30 Oct 30 22:32:55.992121 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:55.991970 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kube-rbac-proxy" containerID="cri-o://69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7" gracePeriod=30 Oct 30 22:32:56.539084 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:32:56.539038 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:32:57.058755 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:57.058719 4472 generic.go:356] "Generic (PLEG): container finished" podID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerID="69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7" exitCode=0 Oct 30 22:32:57.059235 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:57.058792 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerDied","Data":"69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7"} Oct 30 22:32:57.481548 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:32:57.481500 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:33:01.729530 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:01.729481 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.31:8080: connect: connection refused" Oct 30 22:33:02.481917 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:02.481879 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.31:8643/healthz\": dial tcp 10.133.0.31:8643: connect: connection refused" Oct 30 22:33:05.968930 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:05.968892 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:33:06.534175 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.534150 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:33:06.582584 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.582553 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location\") pod \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " Oct 30 22:33:06.582782 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.582599 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp\" (UniqueName: \"kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp\") pod \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " Oct 30 22:33:06.582782 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.582640 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config\") pod \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " Oct 30 22:33:06.582782 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.582681 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert\") pod \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " Oct 30 22:33:06.582782 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.582708 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls\" (UniqueName: \"kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls\") pod \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\" (UID: \"59396fcd-13fb-4be4-b78e-d7fcdacb00c8\") " Oct 30 22:33:06.583054 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.583024 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location" pod "59396fcd-13fb-4be4-b78e-d7fcdacb00c8" (UID: "59396fcd-13fb-4be4-b78e-d7fcdacb00c8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:33:06.583113 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.583081 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config" pod "59396fcd-13fb-4be4-b78e-d7fcdacb00c8" (UID: "59396fcd-13fb-4be4-b78e-d7fcdacb00c8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:06.583113 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.583076 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert" pod "59396fcd-13fb-4be4-b78e-d7fcdacb00c8" (UID: "59396fcd-13fb-4be4-b78e-d7fcdacb00c8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:06.584895 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.584852 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp" pod "59396fcd-13fb-4be4-b78e-d7fcdacb00c8" (UID: "59396fcd-13fb-4be4-b78e-d7fcdacb00c8"). InnerVolumeSpecName "kube-api-access-nx8zp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:33:06.585001 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.584907 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls" pod "59396fcd-13fb-4be4-b78e-d7fcdacb00c8" (UID: "59396fcd-13fb-4be4-b78e-d7fcdacb00c8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:33:06.684037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.683997 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:06.684037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.684031 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:06.684037 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.684040 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:06.684294 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.684051 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx8zp\" (UniqueName: \"kubernetes.io/projected/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-api-access-nx8zp\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:06.684294 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:06.684060 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/59396fcd-13fb-4be4-b78e-d7fcdacb00c8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:07.096217 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.096130 4472 generic.go:356] "Generic (PLEG): container finished" podID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerID="8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace" exitCode=0 Oct 30 22:33:07.096217 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.096186 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerDied","Data":"8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace"} Oct 30 22:33:07.096217 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.096202 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" Oct 30 22:33:07.096721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.096266 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h" event={"ID":"59396fcd-13fb-4be4-b78e-d7fcdacb00c8","Type":"ContainerDied","Data":"3337ad2668d7e64ed0308f2e1c1596fdcb986c726d05114cb16c49f3fb1d5297"} Oct 30 22:33:07.096721 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.096293 4472 scope.go:122] "RemoveContainer" containerID="69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7" Oct 30 22:33:07.105024 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.105005 4472 scope.go:122] "RemoveContainer" containerID="8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace" Oct 30 22:33:07.112033 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.112015 4472 scope.go:122] "RemoveContainer" containerID="20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a" Oct 30 22:33:07.118800 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.118782 4472 scope.go:122] "RemoveContainer" containerID="69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7" Oct 30 22:33:07.119174 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:07.119155 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7\": container with ID starting with 69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7 not found: ID does not exist" containerID="69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7" Oct 30 22:33:07.119240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.119182 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7"} err="failed to get container status \"69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7\": rpc error: code = NotFound desc = could not find container \"69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7\": container with ID starting with 69d87742730407d6ec9ddbc30757e1297214338357f15ccfc5a3cc8aeaea02a7 not found: ID does not exist" Oct 30 22:33:07.119240 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.119201 4472 scope.go:122] "RemoveContainer" containerID="8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace" Oct 30 22:33:07.119413 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:07.119395 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace\": container with ID starting with 8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace not found: ID does not exist" containerID="8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace" Oct 30 22:33:07.119450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.119417 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace"} err="failed to get container status \"8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace\": rpc error: code = NotFound desc = could not find container \"8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace\": container with ID starting with 8f6bac32af49a658000b32df0be75c9edde3882aa1cb07d1c6c8c02696429ace not found: ID does not exist" Oct 30 22:33:07.119450 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.119431 4472 scope.go:122] "RemoveContainer" containerID="20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a" Oct 30 22:33:07.119658 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:07.119637 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a\": container with ID starting with 20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a not found: ID does not exist" containerID="20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a" Oct 30 22:33:07.119713 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.119666 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a"} err="failed to get container status \"20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a\": rpc error: code = NotFound desc = could not find container \"20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a\": container with ID starting with 20ae35a631818c4be1e9415ba782217c88ffaa975e26f302af092794f0b03a5a not found: ID does not exist" Oct 30 22:33:07.164676 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.164655 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h"] Oct 30 22:33:07.177869 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.177834 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw1-2951e75f13/isvc-sklearn-scale-raw-d9aaf-predictor-84fdb5b566-54n5h"] Oct 30 22:33:07.733072 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:07.733036 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" path="/var/lib/kubelet/pods/59396fcd-13fb-4be4-b78e-d7fcdacb00c8/volumes" Oct 30 22:33:15.969010 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:15.968962 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:33:25.967999 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:25.967949 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:33:26.538149 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:26.538114 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:33:35.967911 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:35.967849 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:33:45.969012 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:45.968974 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:33:53.452854 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:53.452821 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p"] Oct 30 22:33:53.453292 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:53.453098 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" containerID="cri-o://eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06" gracePeriod=30 Oct 30 22:33:53.453292 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:53.453170 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kube-rbac-proxy" containerID="cri-o://aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665" gracePeriod=30 Oct 30 22:33:54.269349 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:54.269311 4472 generic.go:356] "Generic (PLEG): container finished" podID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerID="aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665" exitCode=0 Oct 30 22:33:54.269526 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:54.269353 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerDied","Data":"aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665"} Oct 30 22:33:55.963875 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:55.963819 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused" Oct 30 22:33:55.968297 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:55.968263 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused" Oct 30 22:33:56.538285 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:56.538243 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:33:58.500300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.500271 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:33:58.695455 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695425 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config\") pod \"ba08327a-9585-4a4e-b9b0-b55e889a1860\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " Oct 30 22:33:58.695650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695472 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls\") pod \"ba08327a-9585-4a4e-b9b0-b55e889a1860\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " Oct 30 22:33:58.695650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695509 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location\") pod \"ba08327a-9585-4a4e-b9b0-b55e889a1860\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " Oct 30 22:33:58.695650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695563 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert\") pod \"ba08327a-9585-4a4e-b9b0-b55e889a1860\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " Oct 30 22:33:58.695650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695584 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm\" (UniqueName: \"kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm\") pod \"ba08327a-9585-4a4e-b9b0-b55e889a1860\" (UID: \"ba08327a-9585-4a4e-b9b0-b55e889a1860\") " Oct 30 22:33:58.695909 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695881 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location" pod "ba08327a-9585-4a4e-b9b0-b55e889a1860" (UID: "ba08327a-9585-4a4e-b9b0-b55e889a1860"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:33:58.695972 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695919 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config" pod "ba08327a-9585-4a4e-b9b0-b55e889a1860" (UID: "ba08327a-9585-4a4e-b9b0-b55e889a1860"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:58.695972 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.695936 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert" pod "ba08327a-9585-4a4e-b9b0-b55e889a1860" (UID: "ba08327a-9585-4a4e-b9b0-b55e889a1860"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:33:58.697622 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.697602 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm" pod "ba08327a-9585-4a4e-b9b0-b55e889a1860" (UID: "ba08327a-9585-4a4e-b9b0-b55e889a1860"). InnerVolumeSpecName "kube-api-access-m25nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:33:58.697717 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.697698 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls" pod "ba08327a-9585-4a4e-b9b0-b55e889a1860" (UID: "ba08327a-9585-4a4e-b9b0-b55e889a1860"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:33:58.796300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.796264 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:58.796300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.796293 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba08327a-9585-4a4e-b9b0-b55e889a1860-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:58.796300 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.796304 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba08327a-9585-4a4e-b9b0-b55e889a1860-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:58.796585 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.796313 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba08327a-9585-4a4e-b9b0-b55e889a1860-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:58.796585 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:58.796323 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m25nm\" (UniqueName: \"kubernetes.io/projected/ba08327a-9585-4a4e-b9b0-b55e889a1860-kube-api-access-m25nm\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:33:59.290957 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.290919 4472 generic.go:356] "Generic (PLEG): container finished" podID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerID="eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06" exitCode=0 Oct 30 22:33:59.291164 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.290977 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" Oct 30 22:33:59.291164 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.290992 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerDied","Data":"eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06"} Oct 30 22:33:59.291164 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.291047 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p" event={"ID":"ba08327a-9585-4a4e-b9b0-b55e889a1860","Type":"ContainerDied","Data":"5ca1e9b0906f04b118d6747f808505a0d55fadc7b6142f0f9722f24d079ad65f"} Oct 30 22:33:59.291164 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.291076 4472 scope.go:122] "RemoveContainer" containerID="aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665" Oct 30 22:33:59.299944 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.299925 4472 scope.go:122] "RemoveContainer" containerID="eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06" Oct 30 22:33:59.307027 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.307007 4472 scope.go:122] "RemoveContainer" containerID="ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a" Oct 30 22:33:59.319678 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.319659 4472 scope.go:122] "RemoveContainer" containerID="aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665" Oct 30 22:33:59.319948 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:59.319929 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665\": container with ID starting with aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665 not found: ID does not exist" containerID="aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665" Oct 30 22:33:59.319994 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.319957 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665"} err="failed to get container status \"aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665\": rpc error: code = NotFound desc = could not find container \"aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665\": container with ID starting with aa6231f6194b36e282717b5ebe5ff8f90ba3ac5b59fe8a2b9a0c4e972d322665 not found: ID does not exist" Oct 30 22:33:59.319994 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.319974 4472 scope.go:122] "RemoveContainer" containerID="eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06" Oct 30 22:33:59.320200 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:59.320182 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06\": container with ID starting with eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06 not found: ID does not exist" containerID="eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06" Oct 30 22:33:59.320243 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.320205 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06"} err="failed to get container status \"eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06\": rpc error: code = NotFound desc = could not find container \"eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06\": container with ID starting with eb13a8747920c4bce040ad8836e176450e1986ac60eb1d1f934dae0a4ce29b06 not found: ID does not exist" Oct 30 22:33:59.320243 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.320220 4472 scope.go:122] "RemoveContainer" containerID="ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a" Oct 30 22:33:59.320434 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:33:59.320415 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a\": container with ID starting with ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a not found: ID does not exist" containerID="ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a" Oct 30 22:33:59.320470 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.320441 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a"} err="failed to get container status \"ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a\": rpc error: code = NotFound desc = could not find container \"ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a\": container with ID starting with ad8908b00660745824452e33479135d1caed85189534d4dd2105eb766741306a not found: ID does not exist" Oct 30 22:33:59.360260 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.360222 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p"] Oct 30 22:33:59.374046 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.374019 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-create-predictor-54d47cbf97-sts9p"] Oct 30 22:33:59.733152 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:33:59.733117 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" path="/var/lib/kubelet/pods/ba08327a-9585-4a4e-b9b0-b55e889a1860/volumes" Oct 30 22:34:01.250923 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.250889 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6"] Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251177 4472 cpu_manager.go:414] "containerMap: removing container" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kube-rbac-proxy" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251188 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kube-rbac-proxy" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251201 4472 cpu_manager.go:414] "containerMap: removing container" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="storage-initializer" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251206 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="storage-initializer" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251214 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="storage-initializer" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251220 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="storage-initializer" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251226 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251230 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251239 4472 cpu_manager.go:414] "containerMap: removing container" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251243 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251249 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kube-rbac-proxy" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251253 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kube-rbac-proxy" Oct 30 22:34:01.251314 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251317 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kube-rbac-proxy" Oct 30 22:34:01.251680 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251326 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kserve-container" Oct 30 22:34:01.251680 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251332 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="59396fcd-13fb-4be4-b78e-d7fcdacb00c8" containerName="kserve-container" Oct 30 22:34:01.251680 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.251336 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba08327a-9585-4a4e-b9b0-b55e889a1860" containerName="kube-rbac-proxy" Oct 30 22:34:01.254555 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.254534 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.278414 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.278386 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"seaweedfs-s3-creds\"" Oct 30 22:34:01.282180 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.282152 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"default-dockercfg-7rhfl\"" Oct 30 22:34:01.282180 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.282176 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Oct 30 22:34:01.295523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.295488 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Oct 30 22:34:01.295523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.295489 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"odh-kserve-custom-ca-bundle\"" Oct 30 22:34:01.295523 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.295500 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"kube-root-ca.crt\"" Oct 30 22:34:01.295769 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.295543 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-306b77ff42\"/\"openshift-service-ca.crt\"" Oct 30 22:34:01.296937 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.296844 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6"] Oct 30 22:34:01.315104 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.315065 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.315104 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.315111 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.315355 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.315134 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdtqc\" (UniqueName: \"kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.315355 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.315276 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.315355 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.315314 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416007 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.415970 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416178 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416021 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416178 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416057 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdtqc\" (UniqueName: \"kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416178 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416088 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416390 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416217 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416689 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416666 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416786 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416736 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.416850 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.416777 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.418559 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.418538 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.436921 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.436889 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27"] Oct 30 22:34:01.440393 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.440365 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.442708 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.442679 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdtqc\" (UniqueName: \"kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc\") pod \"isvc-canary-promote-v2-predictor-6845fc788-hffj6\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.464169 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.464140 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27"] Oct 30 22:34:01.477986 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.477956 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-306b77ff42\"/\"isvc-canary-promote-predictor-serving-cert\"" Oct 30 22:34:01.516960 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.516881 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.516960 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.516935 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.517144 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.516997 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.517144 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.517044 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqwfz\" (UniqueName: \"kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.517144 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.517063 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.570669 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.570631 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:01.617809 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.617773 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.618003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.617841 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.618003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.617911 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqwfz\" (UniqueName: \"kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.618003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.617940 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.618003 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.617974 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.618420 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.618394 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.619516 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.619398 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.622967 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.620166 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.622967 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.621882 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.644604 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.644571 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqwfz\" (UniqueName: \"kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz\") pod \"isvc-canary-promote-predictor-5dc89bc9c5-hml27\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.764546 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.764505 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:01.879650 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:01.879623 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6"] Oct 30 22:34:01.880756 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:34:01.880728 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7fc52c_75f8_4984_b3a8_e4c3a3f7635c.slice/crio-97ad8e1e3dc011a3ea2b5de64b2bcc8ab00e985ba3ca3f2123543e85fd54bbf6 WatchSource:0}: Error finding container 97ad8e1e3dc011a3ea2b5de64b2bcc8ab00e985ba3ca3f2123543e85fd54bbf6: Status 404 returned error can't find the container with id 97ad8e1e3dc011a3ea2b5de64b2bcc8ab00e985ba3ca3f2123543e85fd54bbf6 Oct 30 22:34:02.063770 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:02.063740 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27"] Oct 30 22:34:02.064472 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:34:02.064436 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a381e3_2ccc_4400_be00_d516e5cb83d2.slice/crio-002cb5afd3c7d8c63381b8ca4b9afe095738ab8b225eea9d21b5d33059df388c WatchSource:0}: Error finding container 002cb5afd3c7d8c63381b8ca4b9afe095738ab8b225eea9d21b5d33059df388c: Status 404 returned error can't find the container with id 002cb5afd3c7d8c63381b8ca4b9afe095738ab8b225eea9d21b5d33059df388c Oct 30 22:34:02.306252 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:02.306209 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerStarted","Data":"a71dbb6d2b2e9fe645d60cf42c51bdcbf6c975dd72e0acb1b86a3db92245faf8"} Oct 30 22:34:02.306730 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:02.306315 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerStarted","Data":"002cb5afd3c7d8c63381b8ca4b9afe095738ab8b225eea9d21b5d33059df388c"} Oct 30 22:34:02.307937 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:02.307912 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerStarted","Data":"46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21"} Oct 30 22:34:02.308056 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:02.307964 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerStarted","Data":"97ad8e1e3dc011a3ea2b5de64b2bcc8ab00e985ba3ca3f2123543e85fd54bbf6"} Oct 30 22:34:06.329681 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:06.329599 4472 generic.go:356] "Generic (PLEG): container finished" podID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerID="a71dbb6d2b2e9fe645d60cf42c51bdcbf6c975dd72e0acb1b86a3db92245faf8" exitCode=0 Oct 30 22:34:06.329681 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:06.329670 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerDied","Data":"a71dbb6d2b2e9fe645d60cf42c51bdcbf6c975dd72e0acb1b86a3db92245faf8"} Oct 30 22:34:06.331275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:06.331251 4472 generic.go:356] "Generic (PLEG): container finished" podID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerID="46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21" exitCode=0 Oct 30 22:34:06.331391 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:06.331307 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerDied","Data":"46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21"} Oct 30 22:34:07.338267 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.338228 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerStarted","Data":"abb654bb1c0c117139b3e0ba4bfcd9debc0b9fb3159e416602a24fed4484eeb0"} Oct 30 22:34:07.338732 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.338331 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerStarted","Data":"fcea65130992d7110c7efff1baa510b35805be0eea741dcdfecf34428d5f6b74"} Oct 30 22:34:07.338732 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.338536 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:07.340374 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.340352 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerStarted","Data":"43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707"} Oct 30 22:34:07.340463 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.340399 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerStarted","Data":"f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f"} Oct 30 22:34:07.340635 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.340619 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:07.388801 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.388747 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podStartSLOduration=2.575314626 podStartE2EDuration="6.388735173s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.813420547s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:34:07.387679162 +0000 UTC m=+1581.762221700" watchObservedRunningTime="2026-10-30 22:34:07.388735173 +0000 UTC m=+1581.763277711" Oct 30 22:34:07.436180 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:07.436127 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podStartSLOduration=2.214014405 podStartE2EDuration="6.436111845s" totalImagesPullingTime="0s" totalInitContainerRuntime="4.22209744s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:34:07.435428879 +0000 UTC m=+1581.809971416" watchObservedRunningTime="2026-10-30 22:34:07.436111845 +0000 UTC m=+1581.810654383" Oct 30 22:34:08.345166 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:08.345044 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:08.345166 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:08.345114 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:08.345987 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:08.345960 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:08.346075 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:08.346026 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:09.348999 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:09.348960 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:09.349437 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:09.349090 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:14.353200 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:14.353164 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:34:14.353806 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:14.353776 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:14.353849 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:14.353808 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:34:14.354324 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:14.354305 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:24.353905 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:24.353851 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:24.354492 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:24.354333 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:26.537734 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:34:26.537694 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:34:34.354097 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:34.354057 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:34.354491 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:34.354177 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:44.354463 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:44.354424 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:44.354907 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:44.354421 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:54.353745 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:54.353707 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:34:54.354229 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:34:54.354205 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:34:56.538422 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:34:56.538385 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:35:04.354030 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:04.353984 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:35:04.354425 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:04.354278 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:35:14.354040 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:14.353998 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused" Oct 30 22:35:14.354456 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:14.354222 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:35:24.355048 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:24.355015 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:35:24.355532 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:24.355122 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:35:24.840125 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:24.840086 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27"] Oct 30 22:35:24.840406 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:24.840362 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" containerID="cri-o://fcea65130992d7110c7efff1baa510b35805be0eea741dcdfecf34428d5f6b74" gracePeriod=30 Oct 30 22:35:24.840512 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:24.840392 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kube-rbac-proxy" containerID="cri-o://abb654bb1c0c117139b3e0ba4bfcd9debc0b9fb3159e416602a24fed4484eeb0" gracePeriod=30 Oct 30 22:35:25.627378 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:25.627345 4472 generic.go:356] "Generic (PLEG): container finished" podID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerID="abb654bb1c0c117139b3e0ba4bfcd9debc0b9fb3159e416602a24fed4484eeb0" exitCode=0 Oct 30 22:35:25.627782 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:25.627416 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerDied","Data":"abb654bb1c0c117139b3e0ba4bfcd9debc0b9fb3159e416602a24fed4484eeb0"} Oct 30 22:35:26.537842 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:35:26.537800 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:35:29.350174 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.350086 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.34:8643/healthz\": dial tcp 10.133.0.34:8643: connect: connection refused" Oct 30 22:35:29.646793 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.646762 4472 generic.go:356] "Generic (PLEG): container finished" podID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerID="fcea65130992d7110c7efff1baa510b35805be0eea741dcdfecf34428d5f6b74" exitCode=0 Oct 30 22:35:29.646980 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.646816 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerDied","Data":"fcea65130992d7110c7efff1baa510b35805be0eea741dcdfecf34428d5f6b74"} Oct 30 22:35:29.684774 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.684751 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:35:29.780504 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.780473 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config\") pod \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " Oct 30 22:35:29.780504 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.780506 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz\" (UniqueName: \"kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz\") pod \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " Oct 30 22:35:29.780764 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.780529 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location\") pod \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " Oct 30 22:35:29.780764 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.780562 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert\") pod \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " Oct 30 22:35:29.780764 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.780600 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls\" (UniqueName: \"kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls\") pod \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\" (UID: \"e8a381e3-2ccc-4400-be00-d516e5cb83d2\") " Oct 30 22:35:29.780966 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.780935 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location" pod "e8a381e3-2ccc-4400-be00-d516e5cb83d2" (UID: "e8a381e3-2ccc-4400-be00-d516e5cb83d2"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:35:29.781028 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.781003 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config" pod "e8a381e3-2ccc-4400-be00-d516e5cb83d2" (UID: "e8a381e3-2ccc-4400-be00-d516e5cb83d2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:35:29.781074 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.781028 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert" pod "e8a381e3-2ccc-4400-be00-d516e5cb83d2" (UID: "e8a381e3-2ccc-4400-be00-d516e5cb83d2"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:35:29.782692 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.782664 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls" pod "e8a381e3-2ccc-4400-be00-d516e5cb83d2" (UID: "e8a381e3-2ccc-4400-be00-d516e5cb83d2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:35:29.782815 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.782711 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz" pod "e8a381e3-2ccc-4400-be00-d516e5cb83d2" (UID: "e8a381e3-2ccc-4400-be00-d516e5cb83d2"). InnerVolumeSpecName "kube-api-access-pqwfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:35:29.881251 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.881173 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqwfz\" (UniqueName: \"kubernetes.io/projected/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-api-access-pqwfz\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:35:29.881251 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.881205 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:35:29.881251 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.881215 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:35:29.881251 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.881225 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e8a381e3-2ccc-4400-be00-d516e5cb83d2-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:35:29.881251 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:29.881233 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e8a381e3-2ccc-4400-be00-d516e5cb83d2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:35:30.651619 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.651589 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" Oct 30 22:35:30.652026 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.651583 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27" event={"ID":"e8a381e3-2ccc-4400-be00-d516e5cb83d2","Type":"ContainerDied","Data":"002cb5afd3c7d8c63381b8ca4b9afe095738ab8b225eea9d21b5d33059df388c"} Oct 30 22:35:30.652026 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.651734 4472 scope.go:122] "RemoveContainer" containerID="abb654bb1c0c117139b3e0ba4bfcd9debc0b9fb3159e416602a24fed4484eeb0" Oct 30 22:35:30.659825 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.659808 4472 scope.go:122] "RemoveContainer" containerID="fcea65130992d7110c7efff1baa510b35805be0eea741dcdfecf34428d5f6b74" Oct 30 22:35:30.666696 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.666678 4472 scope.go:122] "RemoveContainer" containerID="a71dbb6d2b2e9fe645d60cf42c51bdcbf6c975dd72e0acb1b86a3db92245faf8" Oct 30 22:35:30.721978 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.721954 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27"] Oct 30 22:35:30.735310 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:30.735287 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-predictor-5dc89bc9c5-hml27"] Oct 30 22:35:31.732087 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:35:31.732055 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" path="/var/lib/kubelet/pods/e8a381e3-2ccc-4400-be00-d516e5cb83d2/volumes" Oct 30 22:35:56.538176 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:35:56.538138 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:36:26.537853 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:36:26.537819 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:36:56.537646 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:36:56.537610 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:37:02.040770 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:02.040694 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6"] Oct 30 22:37:02.041318 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:02.040994 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" containerID="cri-o://f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f" gracePeriod=30 Oct 30 22:37:02.041318 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:02.041011 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kube-rbac-proxy" containerID="cri-o://43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707" gracePeriod=30 Oct 30 22:37:02.962843 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:02.962805 4472 generic.go:356] "Generic (PLEG): container finished" podID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerID="43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707" exitCode=0 Oct 30 22:37:02.963025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:02.962880 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerDied","Data":"43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707"} Oct 30 22:37:04.349285 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:04.349250 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused" Oct 30 22:37:04.354608 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:04.354580 4472 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused" Oct 30 22:37:06.288108 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.288084 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:37:06.427818 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.427794 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location\") pod \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " Oct 30 22:37:06.427974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.427832 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert\") pod \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " Oct 30 22:37:06.427974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.427876 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls\") pod \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " Oct 30 22:37:06.427974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.427905 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc\" (UniqueName: \"kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc\") pod \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " Oct 30 22:37:06.427974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.427943 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config\") pod \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\" (UID: \"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c\") " Oct 30 22:37:06.428196 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.428168 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location" pod "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" (UID: "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 22:37:06.428275 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.428242 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert" pod "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" (UID: "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:37:06.428396 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.428373 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config" pod "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" (UID: "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:37:06.429977 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.429952 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls" pod "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" (UID: "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:37:06.430063 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.430042 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc" pod "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" (UID: "ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c"). InnerVolumeSpecName "kube-api-access-jdtqc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:37:06.528631 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.528607 4472 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kserve-provision-location\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.528631 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.528627 4472 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-cabundle-cert\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.528768 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.528639 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.528768 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.528648 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdtqc\" (UniqueName: \"kubernetes.io/projected/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-api-access-jdtqc\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.528768 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.528656 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:37:06.978282 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.978252 4472 generic.go:356] "Generic (PLEG): container finished" podID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerID="f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f" exitCode=0 Oct 30 22:37:06.978415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.978305 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" Oct 30 22:37:06.978415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.978327 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerDied","Data":"f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f"} Oct 30 22:37:06.978415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.978385 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6" event={"ID":"ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c","Type":"ContainerDied","Data":"97ad8e1e3dc011a3ea2b5de64b2bcc8ab00e985ba3ca3f2123543e85fd54bbf6"} Oct 30 22:37:06.978415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.978411 4472 scope.go:122] "RemoveContainer" containerID="43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707" Oct 30 22:37:06.986643 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.986626 4472 scope.go:122] "RemoveContainer" containerID="f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f" Oct 30 22:37:06.993609 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:06.993593 4472 scope.go:122] "RemoveContainer" containerID="46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21" Oct 30 22:37:07.000292 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.000276 4472 scope.go:122] "RemoveContainer" containerID="43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707" Oct 30 22:37:07.000596 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:37:07.000572 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707\": container with ID starting with 43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707 not found: ID does not exist" containerID="43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707" Oct 30 22:37:07.000640 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.000609 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707"} err="failed to get container status \"43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707\": rpc error: code = NotFound desc = could not find container \"43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707\": container with ID starting with 43f4c8de0c46befcb32870bb1c0d2c069a13abeb57aa93a127b1b23fcbab2707 not found: ID does not exist" Oct 30 22:37:07.000640 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.000628 4472 scope.go:122] "RemoveContainer" containerID="f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f" Oct 30 22:37:07.000928 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:37:07.000850 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f\": container with ID starting with f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f not found: ID does not exist" containerID="f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f" Oct 30 22:37:07.000974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.000935 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f"} err="failed to get container status \"f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f\": rpc error: code = NotFound desc = could not find container \"f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f\": container with ID starting with f33e8347e554a5da438d710eaa155e665cfc630f8f6107cf2765b721ba335a6f not found: ID does not exist" Oct 30 22:37:07.000974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.000950 4472 scope.go:122] "RemoveContainer" containerID="46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21" Oct 30 22:37:07.001169 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:37:07.001152 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21\": container with ID starting with 46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21 not found: ID does not exist" containerID="46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21" Oct 30 22:37:07.001208 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.001173 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21"} err="failed to get container status \"46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21\": rpc error: code = NotFound desc = could not find container \"46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21\": container with ID starting with 46246865748c178ed091fccfda0c7427a5f39ee2ca4fe3439adaeab0aae9ce21 not found: ID does not exist" Oct 30 22:37:07.047110 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.047087 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6"] Oct 30 22:37:07.060101 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.060080 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-306b77ff42/isvc-canary-promote-v2-predictor-6845fc788-hffj6"] Oct 30 22:37:07.732349 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:07.732318 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" path="/var/lib/kubelet/pods/ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c/volumes" Oct 30 22:37:20.414875 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.414823 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2"] Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415223 4472 cpu_manager.go:414] "containerMap: removing container" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415239 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415256 4472 cpu_manager.go:414] "containerMap: removing container" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="storage-initializer" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415266 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="storage-initializer" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415285 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415293 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415320 4472 cpu_manager.go:414] "containerMap: removing container" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kube-rbac-proxy" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415327 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kube-rbac-proxy" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415338 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="storage-initializer" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415345 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="storage-initializer" Oct 30 22:37:20.415352 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415353 4472 cpu_manager.go:414] "containerMap: removing container" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kube-rbac-proxy" Oct 30 22:37:20.415894 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415360 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kube-rbac-proxy" Oct 30 22:37:20.415894 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415435 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kserve-container" Oct 30 22:37:20.415894 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415450 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kube-rbac-proxy" Oct 30 22:37:20.415894 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415459 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba7fc52c-75f8-4984-b3a8-e4c3a3f7635c" containerName="kube-rbac-proxy" Oct 30 22:37:20.415894 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.415467 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8a381e3-2ccc-4400-be00-d516e5cb83d2" containerName="kserve-container" Oct 30 22:37:20.418483 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.418462 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.434768 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.434745 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"openshift-service-ca.crt\"" Oct 30 22:37:20.447952 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.447918 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"message-dumper-raw-cipn-kube-rbac-proxy-sar-config\"" Oct 30 22:37:20.447952 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.447941 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"kube-root-ca.crt\"" Oct 30 22:37:20.448092 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.448010 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"default-dockercfg-7dz8s\"" Oct 30 22:37:20.448141 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.448099 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-gw0-a93fba2bb7\"/\"message-dumper-raw-cipn-predictor-serving-cert\"" Oct 30 22:37:20.449133 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.449107 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2"] Oct 30 22:37:20.524707 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.524687 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.524799 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.524718 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.524799 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.524749 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.625476 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.625450 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.625557 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.625481 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.625608 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.625553 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.626187 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.626170 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.627926 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.627903 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.650588 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.650569 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp\") pod \"message-dumper-raw-cipn-predictor-584cbbb98c-qptr2\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:20.732754 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:20.732703 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:21.031004 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:21.030977 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2"] Oct 30 22:37:21.031838 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:37:21.031812 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ea9d60a_3cbb_43ed_89b2_8f638cd5f85d.slice/crio-217fc7ec638269cf3973bf4673c1cc4eebc2c65b47d1dfbc5b72aabfe5b77df2 WatchSource:0}: Error finding container 217fc7ec638269cf3973bf4673c1cc4eebc2c65b47d1dfbc5b72aabfe5b77df2: Status 404 returned error can't find the container with id 217fc7ec638269cf3973bf4673c1cc4eebc2c65b47d1dfbc5b72aabfe5b77df2 Oct 30 22:37:22.035714 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:22.035672 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" event={"ID":"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d","Type":"ContainerStarted","Data":"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae"} Oct 30 22:37:22.036110 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:22.035744 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" event={"ID":"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d","Type":"ContainerStarted","Data":"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104"} Oct 30 22:37:22.036110 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:22.035773 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" event={"ID":"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d","Type":"ContainerStarted","Data":"217fc7ec638269cf3973bf4673c1cc4eebc2c65b47d1dfbc5b72aabfe5b77df2"} Oct 30 22:37:22.036110 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:22.035813 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:22.085415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:22.085376 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" podStartSLOduration=2.085363879 podStartE2EDuration="2.085363879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:37:22.084662887 +0000 UTC m=+1776.459205428" watchObservedRunningTime="2026-10-30 22:37:22.085363879 +0000 UTC m=+1776.459906417" Oct 30 22:37:23.039168 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:23.039132 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:23.040836 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:23.040814 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:26.538262 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:37:26.538224 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:37:30.050581 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:37:30.050551 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:37:56.537821 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:37:56.537774 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:38:26.538081 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:38:26.538036 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:38:56.538699 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:38:56.538656 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:39:15.849606 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:15.849573 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/e2e-gw0-a93fba2bb7_message-dumper-raw-cipn-predictor-584cbbb98c-qptr2_5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d/kserve-container/0.log" Oct 30 22:39:16.685486 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.685451 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2"] Oct 30 22:39:16.685742 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.685710 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kserve-container" containerID="cri-o://4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104" gracePeriod=30 Oct 30 22:39:16.685898 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.685718 4472 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kube-rbac-proxy" containerID="cri-o://5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae" gracePeriod=30 Oct 30 22:39:16.923095 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.923067 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:39:16.965339 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.965290 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config\") pod \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " Oct 30 22:39:16.965339 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.965333 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls\") pod \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " Oct 30 22:39:16.965487 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.965378 4472 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp\") pod \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\" (UID: \"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d\") " Oct 30 22:39:16.965614 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.965588 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config" pod "5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" (UID: "5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 22:39:16.967435 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.967409 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp" pod "5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" (UID: "5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d"). InnerVolumeSpecName "kube-api-access-vvwbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 22:39:16.967535 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:16.967509 4472 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls" pod "5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" (UID: "5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 22:39:17.066607 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.066585 4472 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-proxy-tls\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:39:17.066697 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.066610 4472 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-api-access-vvwbp\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:39:17.066697 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.066620 4472 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-44.ec2.internal\" DevicePath \"\"" Oct 30 22:39:17.432540 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432509 4472 generic.go:356] "Generic (PLEG): container finished" podID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerID="5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae" exitCode=0 Oct 30 22:39:17.432540 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432534 4472 generic.go:356] "Generic (PLEG): container finished" podID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerID="4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104" exitCode=2 Oct 30 22:39:17.432742 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432562 4472 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" Oct 30 22:39:17.432742 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432563 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" event={"ID":"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d","Type":"ContainerDied","Data":"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae"} Oct 30 22:39:17.432742 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432707 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" event={"ID":"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d","Type":"ContainerDied","Data":"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104"} Oct 30 22:39:17.432963 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432746 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2" event={"ID":"5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d","Type":"ContainerDied","Data":"217fc7ec638269cf3973bf4673c1cc4eebc2c65b47d1dfbc5b72aabfe5b77df2"} Oct 30 22:39:17.432963 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.432787 4472 scope.go:122] "RemoveContainer" containerID="5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae" Oct 30 22:39:17.443587 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.443567 4472 scope.go:122] "RemoveContainer" containerID="4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104" Oct 30 22:39:17.450845 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.450818 4472 scope.go:122] "RemoveContainer" containerID="5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae" Oct 30 22:39:17.451100 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:39:17.451079 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae\": container with ID starting with 5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae not found: ID does not exist" containerID="5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae" Oct 30 22:39:17.451191 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451110 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae"} err="failed to get container status \"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae\": rpc error: code = NotFound desc = could not find container \"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae\": container with ID starting with 5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae not found: ID does not exist" Oct 30 22:39:17.451191 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451133 4472 scope.go:122] "RemoveContainer" containerID="4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104" Oct 30 22:39:17.451372 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:39:17.451353 4472 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104\": container with ID starting with 4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104 not found: ID does not exist" containerID="4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104" Oct 30 22:39:17.451414 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451379 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104"} err="failed to get container status \"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104\": rpc error: code = NotFound desc = could not find container \"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104\": container with ID starting with 4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104 not found: ID does not exist" Oct 30 22:39:17.451414 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451395 4472 scope.go:122] "RemoveContainer" containerID="5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae" Oct 30 22:39:17.451625 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451610 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae"} err="failed to get container status \"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae\": rpc error: code = NotFound desc = could not find container \"5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae\": container with ID starting with 5832b15a0f00f3c95ef99f3bddc92d5a40a7e529539b8ffd585434246752b4ae not found: ID does not exist" Oct 30 22:39:17.451686 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451625 4472 scope.go:122] "RemoveContainer" containerID="4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104" Oct 30 22:39:17.451806 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.451791 4472 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104"} err="failed to get container status \"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104\": rpc error: code = NotFound desc = could not find container \"4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104\": container with ID starting with 4ce3d09e1a69afd1935e946abf3740682b64a190f90ae454ca0d9a7be316f104 not found: ID does not exist" Oct 30 22:39:17.488278 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.488256 4472 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2"] Oct 30 22:39:17.501622 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.501601 4472 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-gw0-a93fba2bb7/message-dumper-raw-cipn-predictor-584cbbb98c-qptr2"] Oct 30 22:39:17.732960 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:39:17.732905 4472 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" path="/var/lib/kubelet/pods/5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d/volumes" Oct 30 22:39:26.537842 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:39:26.537806 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:39:56.537924 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:39:56.537889 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:40:26.538530 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:40:26.538451 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:40:29.653089 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653047 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mprzg/must-gather-zs94v"] Oct 30 22:40:29.653505 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653486 4472 cpu_manager.go:414] "containerMap: removing container" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kserve-container" Oct 30 22:40:29.653556 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653509 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kserve-container" Oct 30 22:40:29.653556 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653530 4472 cpu_manager.go:414] "containerMap: removing container" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kube-rbac-proxy" Oct 30 22:40:29.653556 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653538 4472 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kube-rbac-proxy" Oct 30 22:40:29.653657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653624 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kube-rbac-proxy" Oct 30 22:40:29.653657 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.653638 4472 memory_manager.go:365] "RemoveStaleState removing state" podUID="5ea9d60a-3cbb-43ed-89b2-8f638cd5f85d" containerName="kserve-container" Oct 30 22:40:29.656562 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.656546 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.686168 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.686134 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mprzg\"/\"openshift-service-ca.crt\"" Oct 30 22:40:29.686168 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.686134 4472 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mprzg\"/\"default-dockercfg-gxfc7\"" Oct 30 22:40:29.686403 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.686233 4472 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mprzg\"/\"kube-root-ca.crt\"" Oct 30 22:40:29.687346 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.687321 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mprzg/must-gather-zs94v"] Oct 30 22:40:29.780146 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.780104 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrxt\" (UniqueName: \"kubernetes.io/projected/0841fd47-a8a5-4d86-b359-a0d06fb38913-kube-api-access-pjrxt\") pod \"must-gather-zs94v\" (UID: \"0841fd47-a8a5-4d86-b359-a0d06fb38913\") " pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.780146 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.780147 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0841fd47-a8a5-4d86-b359-a0d06fb38913-must-gather-output\") pod \"must-gather-zs94v\" (UID: \"0841fd47-a8a5-4d86-b359-a0d06fb38913\") " pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.881364 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.881325 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrxt\" (UniqueName: \"kubernetes.io/projected/0841fd47-a8a5-4d86-b359-a0d06fb38913-kube-api-access-pjrxt\") pod \"must-gather-zs94v\" (UID: \"0841fd47-a8a5-4d86-b359-a0d06fb38913\") " pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.881364 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.881363 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0841fd47-a8a5-4d86-b359-a0d06fb38913-must-gather-output\") pod \"must-gather-zs94v\" (UID: \"0841fd47-a8a5-4d86-b359-a0d06fb38913\") " pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.881667 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.881653 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0841fd47-a8a5-4d86-b359-a0d06fb38913-must-gather-output\") pod \"must-gather-zs94v\" (UID: \"0841fd47-a8a5-4d86-b359-a0d06fb38913\") " pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.906710 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.906642 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrxt\" (UniqueName: \"kubernetes.io/projected/0841fd47-a8a5-4d86-b359-a0d06fb38913-kube-api-access-pjrxt\") pod \"must-gather-zs94v\" (UID: \"0841fd47-a8a5-4d86-b359-a0d06fb38913\") " pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:29.981764 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:29.981727 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mprzg/must-gather-zs94v" Oct 30 22:40:30.275848 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:30.275820 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mprzg/must-gather-zs94v"] Oct 30 22:40:30.276754 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:40:30.276731 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0841fd47_a8a5_4d86_b359_a0d06fb38913.slice/crio-09c3406f6012dbda29f9865aae009920bad91cbd177ab8622b035ced701ab5ee WatchSource:0}: Error finding container 09c3406f6012dbda29f9865aae009920bad91cbd177ab8622b035ced701ab5ee: Status 404 returned error can't find the container with id 09c3406f6012dbda29f9865aae009920bad91cbd177ab8622b035ced701ab5ee Oct 30 22:40:30.278750 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:30.278729 4472 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 22:40:30.674837 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:30.674800 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/must-gather-zs94v" event={"ID":"0841fd47-a8a5-4d86-b359-a0d06fb38913","Type":"ContainerStarted","Data":"09c3406f6012dbda29f9865aae009920bad91cbd177ab8622b035ced701ab5ee"} Oct 30 22:40:31.681977 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:31.681939 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/must-gather-zs94v" event={"ID":"0841fd47-a8a5-4d86-b359-a0d06fb38913","Type":"ContainerStarted","Data":"93c15e164c092fc358a07a321e538fd10a8e5dce4caf590eb800578c8e5df737"} Oct 30 22:40:31.682579 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:31.682537 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/must-gather-zs94v" event={"ID":"0841fd47-a8a5-4d86-b359-a0d06fb38913","Type":"ContainerStarted","Data":"337dae68a7f3c4ee727c26d10b288294ed86de2fe3723e777c80f3690c9b9336"} Oct 30 22:40:31.724145 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:31.724090 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-mprzg/must-gather-zs94v" podStartSLOduration=1.935730708 podStartE2EDuration="2.724075697s" totalImagesPullingTime="788.344989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:31.724050691 +0000 UTC m=+1966.098593231" watchObservedRunningTime="2026-10-30 22:40:31.724075697 +0000 UTC m=+1966.098618235" Oct 30 22:40:33.916394 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:33.916359 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dfsk2_fae7117e-4b5b-4698-8369-825a1583d108/global-pull-secret-syncer/0.log" Oct 30 22:40:35.053174 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:35.053144 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jxn8m_c717de0c-8143-4d25-926b-5f948a9d7903/konnectivity-agent/0.log" Oct 30 22:40:35.478162 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:35.478122 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-44.ec2.internal_c871cf99dd9dbde7be3b85cc0f154c8c/haproxy/0.log" Oct 30 22:40:42.230272 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.230242 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcnqm_6f3f9a41-666d-4192-b269-9da070227251/node-exporter/0.log" Oct 30 22:40:42.358169 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.358143 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcnqm_6f3f9a41-666d-4192-b269-9da070227251/kube-rbac-proxy/0.log" Oct 30 22:40:42.486690 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.486615 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fcnqm_6f3f9a41-666d-4192-b269-9da070227251/init-textfile/0.log" Oct 30 22:40:42.805539 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.805454 4472 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng"] Oct 30 22:40:42.808917 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.808897 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.831267 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.831236 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-sys\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.831419 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.831301 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-proc\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.831419 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.831369 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8xv\" (UniqueName: \"kubernetes.io/projected/499a0bf4-8e5d-41ad-986f-acb53c19dde1-kube-api-access-jl8xv\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.831512 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.831417 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-lib-modules\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.831512 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.831466 4472 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-podres\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.837126 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.837094 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng"] Oct 30 22:40:42.932815 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.932782 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-sys\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.932847 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-proc\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.932903 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8xv\" (UniqueName: \"kubernetes.io/projected/499a0bf4-8e5d-41ad-986f-acb53c19dde1-kube-api-access-jl8xv\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.932929 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-sys\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.932946 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-lib-modules\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.932990 4472 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-podres\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933025 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.933019 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-lib-modules\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933417 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.933050 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-proc\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.933417 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.933076 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/499a0bf4-8e5d-41ad-986f-acb53c19dde1-podres\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:42.957974 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:42.957952 4472 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8xv\" (UniqueName: \"kubernetes.io/projected/499a0bf4-8e5d-41ad-986f-acb53c19dde1-kube-api-access-jl8xv\") pod \"perf-node-gather-daemonset-6r7ng\" (UID: \"499a0bf4-8e5d-41ad-986f-acb53c19dde1\") " pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:43.121916 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:43.121828 4472 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:43.428256 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:43.428225 4472 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng"] Oct 30 22:40:43.429044 ip-10-0-139-44 kubenswrapper[4472]: W1030 22:40:43.429020 4472 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod499a0bf4_8e5d_41ad_986f_acb53c19dde1.slice/crio-80d85089bd936ad0d51637bd1810b1359297a5976f6432ab3629f33174b70017 WatchSource:0}: Error finding container 80d85089bd936ad0d51637bd1810b1359297a5976f6432ab3629f33174b70017: Status 404 returned error can't find the container with id 80d85089bd936ad0d51637bd1810b1359297a5976f6432ab3629f33174b70017 Oct 30 22:40:43.763576 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:43.763498 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" event={"ID":"499a0bf4-8e5d-41ad-986f-acb53c19dde1","Type":"ContainerStarted","Data":"8be440f12fb7ef9cd299abfbd5c6b2f0d22a9033082b934b1795857ad916a82c"} Oct 30 22:40:43.763576 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:43.763552 4472 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" event={"ID":"499a0bf4-8e5d-41ad-986f-acb53c19dde1","Type":"ContainerStarted","Data":"80d85089bd936ad0d51637bd1810b1359297a5976f6432ab3629f33174b70017"} Oct 30 22:40:43.763771 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:43.763621 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:43.814776 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:43.810458 4472 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" podStartSLOduration=1.8104409860000001 podStartE2EDuration="1.810440986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:40:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:40:43.808929632 +0000 UTC m=+1978.183472171" watchObservedRunningTime="2026-10-30 22:40:43.810440986 +0000 UTC m=+1978.184983525" Oct 30 22:40:44.289908 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:44.289874 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-wmn6x_631044a4-a5ff-45cb-adb6-345f931e72bb/prometheus-operator/0.log" Oct 30 22:40:44.414058 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:44.414028 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-wmn6x_631044a4-a5ff-45cb-adb6-345f931e72bb/kube-rbac-proxy/0.log" Oct 30 22:40:44.546156 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:44.546090 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-6z2jp_05d3b36c-ab52-431f-9325-f22334a8896d/prometheus-operator-admission-webhook/0.log" Oct 30 22:40:49.007087 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:49.007057 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c6c8988d6-vhshw_4ecbc524-3b52-4e40-94a3-081580ccf798/console/0.log" Oct 30 22:40:49.142415 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:49.142383 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-cfqxk_b5ec06f4-f43a-4de9-ac7c-5ad61065481c/download-server/0.log" Oct 30 22:40:49.778282 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:49.778254 4472 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mprzg/perf-node-gather-daemonset-6r7ng" Oct 30 22:40:52.762842 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:52.762813 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tc4nf_3a9929a9-860d-44f5-810c-694da46d6b16/dns/0.log" Oct 30 22:40:52.906442 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:52.906409 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tc4nf_3a9929a9-860d-44f5-810c-694da46d6b16/kube-rbac-proxy/0.log" Oct 30 22:40:53.171341 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:53.171313 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kjm85_13bd0c97-042f-4a9b-b685-e40d3480ae12/dns-node-resolver/0.log" Oct 30 22:40:54.386971 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:54.386941 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-657b7d784c-mhrnh_3da0545a-84ee-4825-8fba-84d884a3c29d/registry/0.log" Oct 30 22:40:54.647615 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:54.647584 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nm8gp_30416ea7-1ca2-4983-8de2-5e881a3a9717/node-ca/0.log" Oct 30 22:40:56.539203 ip-10-0-139-44 kubenswrapper[4472]: E1030 22:40:56.539168 4472 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-ct89t" containerName="extractor" Oct 30 22:40:57.567952 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:57.567917 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pwj7j_743e187e-782e-427b-8484-5b85f36f6a37/serve-healthcheck-canary/0.log" Oct 30 22:40:59.094746 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:59.094719 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ct89t_12bf9532-314f-4f06-a71d-1007aa71b1a3/kube-rbac-proxy/0.log" Oct 30 22:40:59.222017 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:59.221976 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ct89t_12bf9532-314f-4f06-a71d-1007aa71b1a3/exporter/0.log" Oct 30 22:40:59.353919 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:59.353830 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ct89t_12bf9532-314f-4f06-a71d-1007aa71b1a3/extractor/0.log" Oct 30 22:40:59.878192 ip-10-0-139-44 kubenswrapper[4472]: I1030 22:40:59.878157 4472 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-vjcn6-cc4xd_5fe77b02-cc5c-4e86-a373-660e706be87e/insights-gathering/0.log"