Oct 30 12:56:23.373135 ip-10-0-130-34 systemd[1]: Starting Kubernetes Kubelet... Oct 30 12:56:23.828104 ip-10-0-130-34 kubenswrapper[2539]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 12:56:23.828748 ip-10-0-130-34 kubenswrapper[2539]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 12:56:23.828748 ip-10-0-130-34 kubenswrapper[2539]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 12:56:23.828748 ip-10-0-130-34 kubenswrapper[2539]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 12:56:23.831870 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831742 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.831870 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831867 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.831870 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831871 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.831870 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831875 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831879 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831883 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831887 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831891 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831894 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831898 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831902 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831905 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831910 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831914 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831918 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831922 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831926 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831930 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831933 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831937 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831941 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831946 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831949 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.832116 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831953 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831957 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831961 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831965 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831969 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831977 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831982 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831986 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831990 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831994 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.831999 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832003 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832008 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832012 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832017 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832022 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832026 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832030 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832034 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.832944 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832038 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832043 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832047 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832051 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832056 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832063 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832070 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832075 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832079 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832083 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832088 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832092 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832097 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832101 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832105 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832110 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832114 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832119 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832123 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.833713 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832129 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832134 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832138 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832143 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832147 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832152 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832156 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832163 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832168 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832172 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832176 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832182 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832186 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832191 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832195 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832199 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832204 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832208 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832212 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832217 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.834529 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832221 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832226 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832230 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832235 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832239 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832242 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832247 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832251 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832255 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832259 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832263 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832267 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832272 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832279 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832285 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832289 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832293 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832297 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832301 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.835384 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832308 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832312 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832316 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832322 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832326 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.832330 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833620 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833630 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833635 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833640 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833644 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833649 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833653 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833658 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833663 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833667 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833671 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833675 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833680 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833684 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.835949 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833688 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833693 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833697 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833701 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833705 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833711 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833716 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833720 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833746 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833752 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833757 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833761 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833767 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833771 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833775 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833779 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833783 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833788 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833792 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.836442 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833796 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833800 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833807 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833813 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833818 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833822 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833826 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833833 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833837 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833842 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833846 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833850 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833855 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833860 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833864 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833868 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833872 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833877 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833881 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.837288 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833885 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833889 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833893 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833897 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833902 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833906 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833912 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833916 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833921 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833925 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833929 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833933 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833937 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833941 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833946 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833950 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833954 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833958 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833962 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833967 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.838244 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833971 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833976 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833980 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833985 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833991 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833995 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.833999 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834003 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834007 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834012 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834017 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834021 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834026 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834030 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834034 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834038 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834043 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834047 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834052 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834057 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.838962 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834061 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834065 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834069 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834073 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834077 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834081 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834085 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834089 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834093 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834097 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834101 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834105 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834109 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834114 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834947 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834956 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834960 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834964 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834969 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834973 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.839462 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834977 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834983 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834988 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834992 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.834996 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835001 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835005 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835009 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835013 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835018 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835024 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835029 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835033 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835037 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835042 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835046 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835050 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835054 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835058 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835063 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.840193 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835068 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835072 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835079 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835085 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835091 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835096 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835101 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835106 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835110 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835114 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835119 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835123 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835127 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835132 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835137 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835141 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835145 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835149 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835154 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.840738 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835158 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835163 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835169 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835175 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835180 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835184 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835189 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835193 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835197 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835201 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835205 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835209 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835213 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835217 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835222 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835226 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835230 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835235 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835239 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835243 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.841185 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835249 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835253 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835257 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835262 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835265 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835271 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835275 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835279 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835284 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835288 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835292 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835296 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835301 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835304 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835309 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835315 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835319 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835324 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835328 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.841797 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835333 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835337 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835341 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835345 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835349 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835353 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835357 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835362 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835366 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835370 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835374 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835378 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835382 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835388 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835393 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835396 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835400 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835404 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835408 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835412 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.842241 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835418 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.835422 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836445 2539 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836461 2539 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836470 2539 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836478 2539 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836485 2539 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836490 2539 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836497 2539 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836504 2539 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836509 2539 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836514 2539 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836520 2539 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836525 2539 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836530 2539 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836535 2539 flags.go:64] FLAG: --cgroup-root="" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836539 2539 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836544 2539 flags.go:64] FLAG: --client-ca-file="" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836548 2539 flags.go:64] FLAG: --cloud-provider="external" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836553 2539 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836561 2539 flags.go:64] FLAG: --cluster-domain="" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836566 2539 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836571 2539 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836576 2539 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 12:56:23.842706 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836581 2539 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836590 2539 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836596 2539 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836602 2539 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836607 2539 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836612 2539 flags.go:64] FLAG: --contention-profiling="false" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836617 2539 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836621 2539 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836626 2539 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836630 2539 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836638 2539 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836642 2539 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836647 2539 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836652 2539 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836656 2539 flags.go:64] FLAG: --enable-server="true" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836661 2539 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836668 2539 flags.go:64] FLAG: --event-burst="100" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836673 2539 flags.go:64] FLAG: --event-qps="50" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836677 2539 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836682 2539 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836687 2539 flags.go:64] FLAG: --eviction-hard="" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836694 2539 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836699 2539 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836703 2539 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836708 2539 flags.go:64] FLAG: --eviction-soft="" Oct 30 12:56:23.843323 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836713 2539 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836717 2539 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836738 2539 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836743 2539 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836748 2539 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836752 2539 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836757 2539 flags.go:64] FLAG: --feature-gates="" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836768 2539 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836774 2539 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836779 2539 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836784 2539 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836790 2539 flags.go:64] FLAG: --healthz-port="10248" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836795 2539 flags.go:64] FLAG: --help="false" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836800 2539 flags.go:64] FLAG: --hostname-override="ip-10-0-130-34.ec2.internal" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836805 2539 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836810 2539 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836815 2539 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836820 2539 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836825 2539 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836830 2539 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836835 2539 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836839 2539 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836844 2539 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 12:56:23.843963 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836848 2539 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836853 2539 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836858 2539 flags.go:64] FLAG: --kube-reserved="" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836862 2539 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836867 2539 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836872 2539 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836877 2539 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836881 2539 flags.go:64] FLAG: --lock-file="" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836886 2539 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836890 2539 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836895 2539 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836904 2539 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836908 2539 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836912 2539 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836917 2539 flags.go:64] FLAG: --logging-format="text" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836922 2539 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836927 2539 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836933 2539 flags.go:64] FLAG: --manifest-url="" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836938 2539 flags.go:64] FLAG: --manifest-url-header="" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836945 2539 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836950 2539 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836957 2539 flags.go:64] FLAG: --max-pods="110" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836962 2539 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836966 2539 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836971 2539 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 12:56:23.844509 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836976 2539 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836980 2539 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836985 2539 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.836990 2539 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837000 2539 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837005 2539 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837010 2539 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837015 2539 flags.go:64] FLAG: --pod-cidr="" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837019 2539 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837024 2539 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837029 2539 flags.go:64] FLAG: --pods-per-core="0" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837033 2539 flags.go:64] FLAG: --port="10250" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837038 2539 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837042 2539 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03892f4b1ad99399c" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837047 2539 flags.go:64] FLAG: --qos-reserved="" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837052 2539 flags.go:64] FLAG: --read-only-port="10255" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837057 2539 flags.go:64] FLAG: --register-node="true" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837061 2539 flags.go:64] FLAG: --register-with-taints="" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837067 2539 flags.go:64] FLAG: --registry-burst="10" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837072 2539 flags.go:64] FLAG: --registry-qps="5" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837076 2539 flags.go:64] FLAG: --reserved-cpus="" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837080 2539 flags.go:64] FLAG: --reserved-memory="" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837086 2539 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837091 2539 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837097 2539 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837102 2539 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 12:56:23.845166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837108 2539 flags.go:64] FLAG: --runonce="false" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837113 2539 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837118 2539 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837123 2539 flags.go:64] FLAG: --seccomp-default="false" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837128 2539 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837133 2539 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837138 2539 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837143 2539 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837147 2539 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837152 2539 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837157 2539 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837161 2539 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837166 2539 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837171 2539 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837175 2539 flags.go:64] FLAG: --system-cgroups="" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837180 2539 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837189 2539 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837193 2539 flags.go:64] FLAG: --tls-cert-file="" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837198 2539 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837205 2539 flags.go:64] FLAG: --tls-min-version="" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837209 2539 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837214 2539 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837218 2539 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837223 2539 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837228 2539 flags.go:64] FLAG: --v="2" Oct 30 12:56:23.845795 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837235 2539 flags.go:64] FLAG: --version="false" Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837242 2539 flags.go:64] FLAG: --vmodule="" Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837247 2539 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.837253 2539 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837482 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837491 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837496 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837502 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837505 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837510 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837518 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837524 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837529 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837533 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837538 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837543 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837547 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837551 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837555 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.846381 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837559 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837563 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837567 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837571 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837575 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837579 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837583 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837587 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837591 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837595 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837599 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837604 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837608 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837612 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837616 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837620 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837624 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837628 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837638 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837642 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.846886 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837648 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837652 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837657 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837663 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837669 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837679 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837685 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837689 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837694 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837698 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837702 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837706 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837711 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837714 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837719 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837742 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837746 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837751 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837755 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.847352 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837759 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837764 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837768 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837772 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837776 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837780 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837784 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837788 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837793 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837797 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837802 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837808 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837812 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837820 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837824 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837828 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837832 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837837 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837841 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837847 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.847822 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837851 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837855 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837859 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837863 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837867 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837871 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837875 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837880 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837884 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837889 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837893 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837897 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837901 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837905 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837909 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837914 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837918 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837922 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837926 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837930 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.848295 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837935 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837939 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837943 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837948 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837953 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837958 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837962 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837967 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837971 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837975 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837980 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.837984 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.838031 2539 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838097 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838104 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838109 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.848792 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838114 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838119 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838123 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838128 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838132 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838136 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838140 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838144 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838148 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838152 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838156 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838161 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838165 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838169 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838173 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838178 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838182 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838186 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838190 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838196 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.849271 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838200 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838204 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838210 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838214 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838219 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838223 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838227 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838231 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838235 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838244 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838248 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838252 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838256 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838260 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838264 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838269 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838273 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838277 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838282 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.850042 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838289 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838294 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838299 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838303 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838308 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838312 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838316 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838320 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838325 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838330 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838334 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838338 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838344 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838348 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838353 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838360 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838365 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838369 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838373 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838377 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.850484 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838381 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838385 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838389 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838394 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838399 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838403 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838407 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838412 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838416 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838420 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838424 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838428 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838436 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838441 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838447 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838452 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838456 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838460 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838465 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.851038 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838469 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838474 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838478 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838482 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838487 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838493 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838497 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838502 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838507 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838511 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838515 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838519 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838523 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838527 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838532 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838536 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838540 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838546 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838551 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838555 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.851474 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838559 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838564 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838568 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838574 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.838578 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.846320 2539 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.846336 2539 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.846350 2539 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.846355 2539 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846411 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846416 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846420 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846423 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846425 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846428 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846431 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846433 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846436 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846439 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846441 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.851952 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846444 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846446 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846449 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846451 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846454 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846456 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846459 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846461 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846464 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846466 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846468 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846470 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846473 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846475 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846478 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846480 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846482 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846485 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846489 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846491 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.852447 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846494 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846496 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846499 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846501 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846504 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846506 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846509 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846511 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846513 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846516 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846518 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846521 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846523 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846525 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846528 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846531 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846534 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846537 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846541 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.852926 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846543 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846546 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846549 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846551 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846553 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846556 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846558 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846561 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846564 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846566 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846569 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846572 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846575 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846578 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846580 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846583 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846585 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846588 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846590 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846593 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.853354 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846595 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846599 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846603 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846606 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846609 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846612 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846614 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846617 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846619 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846622 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846625 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846627 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846630 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846632 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846635 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846638 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846640 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846643 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846645 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.853839 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846647 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846650 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846652 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846654 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846657 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846660 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846663 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846666 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846668 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846671 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846673 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846675 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846678 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846681 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846683 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846686 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.854277 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846688 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.846714 2539 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846865 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846870 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846873 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846876 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846880 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846883 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846886 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846889 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846892 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846895 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846898 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846901 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846903 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846906 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.854645 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846908 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846911 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846913 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846916 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846918 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846922 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846924 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846927 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846930 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846932 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846935 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846937 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846940 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846943 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846945 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846948 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846951 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846955 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846958 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.855082 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846960 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846963 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846965 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846971 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846974 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846976 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846979 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846981 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846983 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846986 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846989 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846991 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846993 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846996 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.846998 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847001 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847003 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847005 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847009 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847011 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.855520 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847014 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847016 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847019 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847021 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847024 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847027 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847029 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847032 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847034 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847037 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847039 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847042 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847044 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847046 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847049 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847051 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847054 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847056 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847059 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.856006 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847062 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847064 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847067 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847069 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847071 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847074 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847076 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847079 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847081 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847084 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847086 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847089 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847091 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847095 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847099 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847102 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847105 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847107 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847109 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.856433 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847112 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847114 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847117 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847119 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847122 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847124 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847127 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847129 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847132 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847134 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847137 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847139 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847142 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847144 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847147 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.847169 2539 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 12:56:23.856890 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847199 2539 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847203 2539 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847206 2539 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847209 2539 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847212 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847215 2539 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847217 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847220 2539 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847222 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847225 2539 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847227 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847230 2539 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847232 2539 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847235 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847238 2539 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847241 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847243 2539 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847245 2539 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847248 2539 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:56:23.857262 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847250 2539 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847253 2539 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847255 2539 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847258 2539 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847260 2539 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847263 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847265 2539 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847267 2539 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847270 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847272 2539 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847275 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847277 2539 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847281 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847284 2539 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847286 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847290 2539 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847294 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847297 2539 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847300 2539 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:56:23.857688 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847302 2539 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847305 2539 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847308 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847310 2539 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847313 2539 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847315 2539 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847318 2539 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847320 2539 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847323 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847326 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847328 2539 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847330 2539 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847333 2539 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847335 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847337 2539 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847340 2539 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847342 2539 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847345 2539 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847347 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847350 2539 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:56:23.858286 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847352 2539 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847355 2539 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847357 2539 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847360 2539 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847362 2539 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847366 2539 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847369 2539 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847372 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847374 2539 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847376 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847379 2539 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847381 2539 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847384 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847386 2539 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847388 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847391 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847394 2539 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847396 2539 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847400 2539 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:56:23.858777 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847402 2539 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847404 2539 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847407 2539 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847410 2539 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847412 2539 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847414 2539 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847417 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847419 2539 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847422 2539 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847424 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847427 2539 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847429 2539 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847433 2539 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847436 2539 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847439 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847441 2539 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847443 2539 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847446 2539 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847449 2539 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847452 2539 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:56:23.859243 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847454 2539 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847457 2539 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847459 2539 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847462 2539 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847464 2539 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847467 2539 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847469 2539 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847471 2539 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:23.847475 2539 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.847547 2539 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.854951 2539 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.856086 2539 server.go:1014] "Starting client certificate rotation" Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.856177 2539 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.856205 2539 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 12:56:23.859692 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.858510 2539 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 12:56:23.862632 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.862615 2539 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 12:56:23.873920 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.873904 2539 log.go:25] "Validated CRI v1 runtime API" Oct 30 12:56:23.877889 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.877874 2539 log.go:25] "Validated CRI v1 image API" Oct 30 12:56:23.878773 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.878746 2539 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 12:56:23.881565 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.881543 2539 fs.go:135] Filesystem UUIDs: map[073c8bee-a5a4-4dd9-990e-38b234b6fee6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d21eea88-56c6-4140-b4cc-3cc567b9fa5c:/dev/nvme0n1p3] Oct 30 12:56:23.881648 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.881564 2539 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Oct 30 12:56:23.887869 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.887716 2539 manager.go:217] Machine: {Timestamp:2026-10-30 12:56:23.886281612 +0000 UTC m=+0.381932822 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099931 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26fcd79ffef4bc2284fc5921cc73e6 SystemUUID:ec26fcd7-9ffe-f4bc-2284-fc5921cc73e6 BootID:d9820882-a69a-4c0e-a874-7c9545777701 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f6:36:37:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f6:36:37:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:fc:4d:eb:d4:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 12:56:23.887869 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.887862 2539 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 12:56:23.888027 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.887979 2539 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 12:56:23.891546 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.891519 2539 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 12:56:23.891685 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.891547 2539 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 12:56:23.891744 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.891688 2539 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 12:56:23.891744 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.891696 2539 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 12:56:23.891796 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.891759 2539 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 12:56:23.891796 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.891779 2539 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 12:56:23.893152 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.893142 2539 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 12:56:23.897883 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.897871 2539 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 12:56:23.897991 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.897982 2539 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 12:56:23.898823 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.898813 2539 kubelet.go:493] "Attempting to sync node with API server" Oct 30 12:56:23.898870 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.898826 2539 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 12:56:23.898870 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.898840 2539 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 12:56:23.898870 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.898853 2539 kubelet.go:405] "Adding apiserver pod source" Oct 30 12:56:23.898870 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.898865 2539 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 12:56:23.899201 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.899190 2539 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 12:56:23.904929 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.904875 2539 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 12:56:23.911951 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.911935 2539 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 12:56:23.912917 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.912905 2539 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 12:56:23.912954 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.912936 2539 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 12:56:23.913087 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913078 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 12:56:23.913119 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913093 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 12:56:23.913119 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913100 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 12:56:23.913119 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913105 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 12:56:23.913119 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913111 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 12:56:23.913119 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913117 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 12:56:23.913771 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913762 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 12:56:23.913809 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913773 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 12:56:23.913809 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913780 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 12:56:23.913809 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913785 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 12:56:23.913809 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913794 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 12:56:23.913809 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.913804 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 12:56:23.914573 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.914563 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 12:56:23.914602 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.914577 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 12:56:23.918460 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.918446 2539 server.go:1263] "Started kubelet" Oct 30 12:56:23.918548 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.918500 2539 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 12:56:23.918600 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.918554 2539 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 12:56:23.918645 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.918635 2539 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 12:56:23.919224 ip-10-0-130-34 systemd[1]: Started Kubernetes Kubelet. Oct 30 12:56:23.920274 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.920133 2539 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 12:56:23.921343 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.921330 2539 server.go:317] "Adding debug handlers to kubelet server" Oct 30 12:56:23.924779 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.924760 2539 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 30 12:56:23.928697 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.928682 2539 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 12:56:23.928697 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.928690 2539 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 12:56:23.928816 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.928802 2539 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found" Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929525 2539 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929553 2539 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929566 2539 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929615 2539 factory.go:55] Registering systemd factory Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929627 2539 factory.go:223] Registration of the systemd container factory successfully Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929665 2539 reconstruct.go:97] "Volume reconstruction finished" Oct 30 12:56:23.929596 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929675 2539 reconciler.go:29] "Reconciler: start to sync state" Oct 30 12:56:23.930051 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929910 2539 factory.go:153] Registering CRI-O factory Oct 30 12:56:23.930051 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929921 2539 factory.go:223] Registration of the crio container factory successfully Oct 30 12:56:23.930051 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929973 2539 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 12:56:23.930051 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.929989 2539 factory.go:103] Registering Raw factory Oct 30 12:56:23.930051 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.930003 2539 manager.go:1199] Started watching for new ooms in manager Oct 30 12:56:23.931232 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.931089 2539 manager.go:319] Starting recovery of all containers Oct 30 12:56:23.940498 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.940473 2539 manager.go:324] Recovery completed Oct 30 12:56:23.946007 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.945993 2539 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 12:56:23.947870 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.947850 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory" Oct 30 12:56:23.947942 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.947880 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 12:56:23.947942 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.947890 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID" Oct 30 12:56:23.948366 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.948354 2539 cpu_manager.go:226] "Starting" policy="none" Oct 30 12:56:23.948407 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.948366 2539 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 12:56:23.948407 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.948387 2539 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 12:56:23.948475 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.948409 2539 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 12:56:23.949042 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.949029 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory" Oct 30 12:56:23.949086 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.949056 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 12:56:23.949086 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.949066 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID" Oct 30 12:56:23.950582 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.950571 2539 policy_none.go:50] "Start" Oct 30 12:56:23.950631 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.950586 2539 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 12:56:23.950631 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.950596 2539 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 12:56:23.951638 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.951617 2539 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 30 12:56:23.951638 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.951617 2539 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 30 12:56:23.952654 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.952642 2539 policy_none.go:44] "Start" Oct 30 12:56:23.952692 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.951610 2539 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-34.ec2.internal.18e34ff38314ed9c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-34.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-34.ec2.internal,},FirstTimestamp:2026-10-30 12:56:23.918423452 +0000 UTC m=+0.414074657,LastTimestamp:2026-10-30 12:56:23.918423452 +0000 UTC m=+0.414074657,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-34.ec2.internal,}" Oct 30 12:56:23.959082 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.959063 2539 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 12:56:23.959948 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.959933 2539 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxjn6" Oct 30 12:56:23.973700 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.973673 2539 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxjn6" Oct 30 12:56:23.973830 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.973739 2539 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Oct 30 12:56:23.973830 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.973719 2539 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-34.ec2.internal.18e34ff384d639f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-34.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-34.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-34.ec2.internal,},FirstTimestamp:2026-10-30 12:56:23.947868657 +0000 UTC m=+0.443519863,LastTimestamp:2026-10-30 12:56:23.947868657 +0000 UTC m=+0.443519863,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-34.ec2.internal,}" Oct 30 12:56:23.974053 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.974026 2539 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Oct 30 12:56:23.990488 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.990330 2539 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 12:56:23.994396 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994381 2539 manager.go:341] "Starting Device Plugin manager" Oct 30 12:56:23.994482 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.994423 2539 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 12:56:23.994482 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994435 2539 server.go:87] "Starting device plugin registration server" Oct 30 12:56:23.994696 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994684 2539 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 12:56:23.994774 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994698 2539 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 12:56:23.994822 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994789 2539 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 12:56:23.994878 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994868 2539 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 12:56:23.994878 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:23.994875 2539 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 12:56:23.995424 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.995408 2539 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 12:56:23.995502 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:23.995457 2539 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-34.ec2.internal\" not found" Oct 30 12:56:24.004057 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.004036 2539 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:56:24.072130 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.072098 2539 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 12:56:24.074080 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.073551 2539 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 12:56:24.074080 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.073571 2539 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 12:56:24.074080 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.073590 2539 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 12:56:24.074080 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:24.073621 2539 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Oct 30 12:56:24.090572 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.090557 2539 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:56:24.095616 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.095602 2539 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 12:56:24.096495 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.096480 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory" Oct 30 12:56:24.096561 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.096509 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 12:56:24.096561 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.096518 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID" Oct 30 12:56:24.096561 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.096542 2539 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.116772 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.116752 2539 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.116857 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:24.116777 2539 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-34.ec2.internal\": node \"ip-10-0-130-34.ec2.internal\" not found" Oct 30 12:56:24.174288 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.174261 2539 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"] Oct 30 12:56:24.176753 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.176722 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.179067 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.179053 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.199129 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.199109 2539 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.201987 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.201972 2539 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.225887 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.225874 2539 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 12:56:24.225949 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.225911 2539 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 12:56:24.231252 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.231234 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.231311 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.231259 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.231311 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.231281 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed215bcf2fbe8974076cda59d8c09a02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"ed215bcf2fbe8974076cda59d8c09a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.331701 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.331626 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.331701 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.331661 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed215bcf2fbe8974076cda59d8c09a02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"ed215bcf2fbe8974076cda59d8c09a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.331701 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.331677 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.331701 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.331705 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.331929 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.331755 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.331929 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.331762 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed215bcf2fbe8974076cda59d8c09a02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"ed215bcf2fbe8974076cda59d8c09a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.529875 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.529839 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.529875 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.529868 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:56:24.855946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.855910 2539 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 30 12:56:24.856480 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.856035 2539 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Oct 30 12:56:24.899025 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.899007 2539 apiserver.go:52] "Watching apiserver" Oct 30 12:56:24.929032 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.929006 2539 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Oct 30 12:56:24.945020 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.944997 2539 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 12:56:24.946310 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.946276 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal","openshift-image-registry/node-ca-zp996","openshift-multus/multus-nkmrf","kube-system/konnectivity-agent-fnn4j","openshift-dns/node-resolver-fghs2","openshift-cluster-node-tuning-operator/tuned-s7trc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal","openshift-network-diagnostics/network-check-target-ng2cv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86","openshift-multus/multus-additional-cni-plugins-kcqr7","openshift-multus/network-metrics-daemon-wxdwb","openshift-network-operator/iptables-alerter-s4z5v","openshift-ovn-kubernetes/ovnkube-node-v9n64","kube-system/global-pull-secret-syncer-gwd9f"] Oct 30 12:56:24.949148 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.949125 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:24.952383 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.952365 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nkmrf" Oct 30 12:56:24.955295 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.955273 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:24.957316 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.957288 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:24.959422 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.959403 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:24.961456 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.961439 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:24.961552 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:24.961519 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:24.963640 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.963622 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:24.965603 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.965584 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cxt4s\"" Oct 30 12:56:24.965603 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.965599 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 12:56:24.965748 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.965615 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 12:56:24.965748 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.965663 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 12:56:24.966688 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.966671 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:24.968166 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.968151 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 12:56:24.968445 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.968432 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 12:56:24.968445 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.968432 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-sp79l\"" Oct 30 12:56:24.968556 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.968454 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 12:56:24.968556 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.968480 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 12:56:24.968990 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.968974 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:24.969076 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:24.969056 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:24.971060 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.971041 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:24.971154 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.971121 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 12:56:24.971408 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.971392 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 12:56:24.971518 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.971504 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-wsrzk\"" Oct 30 12:56:24.973280 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.973262 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 12:56:24.973280 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.973270 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dz42j\"" Oct 30 12:56:24.973417 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.973293 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 12:56:24.973658 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.973642 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:24.975193 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.975171 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 12:56:24.975285 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.975255 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 12:56:24.975285 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.975255 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-25fk6\"" Oct 30 12:56:24.976525 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.976510 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:24.976597 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:24.976566 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:24.979873 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.979368 2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 12:51:25 +0000 UTC" deadline="2028-04-16 18:41:14.291951782 +0000 UTC" Oct 30 12:56:24.979873 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.979409 2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12821h44m49.312546715s" Oct 30 12:56:24.981645 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.981629 2539 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Oct 30 12:56:24.981749 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.981689 2539 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gdht" Oct 30 12:56:24.989447 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:24.989430 2539 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9gdht" Oct 30 12:56:25.031308 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.031291 2539 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 12:56:25.034490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034195 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-systemd\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.034490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034241 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-registration-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.034490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034292 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa00b791-7a56-4038-83d2-e0f512626697-iptables-alerter-script\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.034490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034328 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-bin\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.034490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034363 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.034490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034451 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysconfig\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.034719 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034514 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2xx8\" (UniqueName: \"kubernetes.io/projected/6a613faa-490e-4961-b7c3-9e08092e06a5-kube-api-access-z2xx8\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.034719 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034584 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-etc-kubernetes\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.034719 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034631 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-modprobe-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.034719 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034667 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-conf\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.034719 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034689 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-slash\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.034719 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034713 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a613faa-490e-4961-b7c3-9e08092e06a5-serviceca\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.034997 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034751 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-conf-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.034997 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034770 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:25.034997 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034785 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-dbus\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.034997 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034941 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-host\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.035108 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.034961 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa00b791-7a56-4038-83d2-e0f512626697-host-slash\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.035108 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035059 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.035108 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035078 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-bin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.035190 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035107 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-hostroot\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.035190 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035153 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-netns\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.035190 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035182 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.035316 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035302 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.035557 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035535 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-sys\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.035619 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035581 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-device-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.035619 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035609 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-sys-fs\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.035720 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035646 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcnbj\" (UniqueName: \"kubernetes.io/projected/7d0598da-23a6-4111-a3f1-f8e90c53674a-kube-api-access-zcnbj\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.035720 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035702 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-script-lib\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.035819 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035782 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-var-lib-kubelet\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.035878 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035836 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-socket-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.035927 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035910 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.035971 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035953 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6rg\" (UniqueName: \"kubernetes.io/projected/b5d62fac-0db6-4150-b580-cc42eac91fb1-kube-api-access-vt6rg\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036017 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.035975 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a613faa-490e-4961-b7c3-9e08092e06a5-host\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.036058 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036004 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.036058 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036052 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98pm7\" (UniqueName: \"kubernetes.io/projected/0e2f926b-3781-439c-b532-ba54972d6b9f-kube-api-access-98pm7\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.036147 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036114 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-lib-modules\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.036147 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036137 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-systemd-units\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036234 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036206 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-ovn\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036280 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036247 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-env-overrides\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036330 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036289 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.036375 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036315 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-run\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.036375 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036361 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:25.036550 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036532 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q4ff\" (UniqueName: \"kubernetes.io/projected/aa00b791-7a56-4038-83d2-e0f512626697-kube-api-access-4q4ff\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.036625 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036597 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-kubelet\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036675 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036640 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-node-log\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036675 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036668 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-netd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036788 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036696 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-config\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.036832 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036788 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-socket-dir-parent\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.036832 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036817 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.036921 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036839 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-cni-binary-copy\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.036921 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036873 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-k8s-cni-cncf-io\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.037006 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.036929 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-multus-daemon-config\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.037038 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037016 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-multus-certs\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.037085 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037065 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.037139 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037122 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2bd8658-22fb-4aa8-a657-a363578881a8-agent-certs\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.037190 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037172 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2bd8658-22fb-4aa8-a657-a363578881a8-konnectivity-ca\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.037241 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037210 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.037292 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037258 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2sl\" (UniqueName: \"kubernetes.io/projected/74918493-bf14-4a8f-a407-14cdbb526a92-kube-api-access-dg2sl\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:25.037343 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037320 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-var-lib-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.037387 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037370 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-etc-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.037426 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037407 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-multus\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.037459 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037440 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-cnibin\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.037500 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037481 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-kubelet-config\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.037561 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037529 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-hosts-file\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.037620 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037564 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-tuned\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.037666 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037618 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-systemd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.037711 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037676 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-cnibin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.037780 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037749 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.037829 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037791 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcctp\" (UniqueName: \"kubernetes.io/projected/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-kube-api-access-zcctp\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.037829 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037819 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-kubernetes\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.037912 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037848 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvwj9\" (UniqueName: \"kubernetes.io/projected/c1568d95-34ae-46fc-8bdf-7a8918cf3973-kube-api-access-wvwj9\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.037912 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037874 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.037912 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037901 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-system-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.038034 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.037930 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-kubelet\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.038034 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038002 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-tmp\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.038108 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038058 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovn-node-metrics-cert\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.038108 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038092 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-netns\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.038521 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038499 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-tmp-dir\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.038597 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038557 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-log-socket\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.038634 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038610 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tfsm\" (UniqueName: \"kubernetes.io/projected/d6a229d1-9609-403c-bde5-1e6238304859-kube-api-access-5tfsm\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.038679 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.038656 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.058847 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.058827 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92414930f024c1b0c2c5fc6bf0ad88b7.slice/crio-82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57 WatchSource:0}: Error finding container 82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57: Status 404 returned error can't find the container with id 82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57 Oct 30 12:56:25.063961 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.063944 2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066363 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066438 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066458 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066629 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066663 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xt92t\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066680 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066702 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066710 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7gdbz\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066749 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066768 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066804 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 12:56:25.066836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066815 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 12:56:25.067257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066873 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 12:56:25.067257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066898 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 12:56:25.067257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066905 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94phb\"" Oct 30 12:56:25.067257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066928 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 12:56:25.067257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066929 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 12:56:25.067257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.066957 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tzbll\"" Oct 30 12:56:25.076818 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.076762 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"92414930f024c1b0c2c5fc6bf0ad88b7","Type":"ContainerStarted","Data":"82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57"} Oct 30 12:56:25.089646 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.089626 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded215bcf2fbe8974076cda59d8c09a02.slice/crio-0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3 WatchSource:0}: Error finding container 0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3: Status 404 returned error can't find the container with id 0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3 Oct 30 12:56:25.139570 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139520 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:25.139570 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139545 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q4ff\" (UniqueName: \"kubernetes.io/projected/aa00b791-7a56-4038-83d2-e0f512626697-kube-api-access-4q4ff\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.139570 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139562 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-kubelet\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139582 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-node-log\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139596 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-netd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139629 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-config\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139656 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-socket-dir-parent\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139662 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-kubelet\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139675 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-node-log\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139672 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139700 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-netd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.139717 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139749 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-cni-binary-copy\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139770 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-k8s-cni-cncf-io\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.139791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139785 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-multus-daemon-config\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.139810 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:25.639790678 +0000 UTC m=+2.135441894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139847 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139847 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-socket-dir-parent\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139847 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-multus-certs\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139884 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-multus-certs\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139893 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139935 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2bd8658-22fb-4aa8-a657-a363578881a8-agent-certs\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139960 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2bd8658-22fb-4aa8-a657-a363578881a8-konnectivity-ca\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139935 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-k8s-cni-cncf-io\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.139993 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.139992 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140022 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2sl\" (UniqueName: \"kubernetes.io/projected/74918493-bf14-4a8f-a407-14cdbb526a92-kube-api-access-dg2sl\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140047 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-var-lib-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.140084 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret podName:774297e4-0a5c-458f-8d10-ecffd469fce1 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:25.640058374 +0000 UTC m=+2.135709586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret") pod "global-pull-secret-syncer-gwd9f" (UID: "774297e4-0a5c-458f-8d10-ecffd469fce1") : object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140090 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-var-lib-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.140385 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140110 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-etc-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140125 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140144 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-multus\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140152 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-etc-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140174 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-cnibin\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140206 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-kubelet-config\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140213 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-multus\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140234 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-hosts-file\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140258 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-cnibin\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140259 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-tuned\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140282 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-systemd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140298 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-cnibin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140313 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-kubelet-config\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140319 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140352 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-systemd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140370 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-hosts-file\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140416 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcctp\" (UniqueName: \"kubernetes.io/projected/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-kube-api-access-zcctp\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140444 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-kubernetes\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.141220 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140453 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-cnibin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140470 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwj9\" (UniqueName: \"kubernetes.io/projected/c1568d95-34ae-46fc-8bdf-7a8918cf3973-kube-api-access-wvwj9\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140480 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140531 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140545 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-kubernetes\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140556 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-system-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140570 2539 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140661 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-kubelet\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140689 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-tmp\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140705 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140714 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovn-node-metrics-cert\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140675 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-system-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140750 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-multus-daemon-config\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140766 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-netns\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140770 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-kubelet\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140800 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-netns\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140812 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2bd8658-22fb-4aa8-a657-a363578881a8-konnectivity-ca\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140834 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-tmp-dir\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.142065 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140884 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-log-socket\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140923 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-log-socket\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.140954 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfsm\" (UniqueName: \"kubernetes.io/projected/d6a229d1-9609-403c-bde5-1e6238304859-kube-api-access-5tfsm\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141158 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141182 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-systemd\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141203 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-registration-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141220 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-config\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141228 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa00b791-7a56-4038-83d2-e0f512626697-iptables-alerter-script\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141248 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-bin\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141270 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141277 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-systemd\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141290 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysconfig\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141313 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xx8\" (UniqueName: \"kubernetes.io/projected/6a613faa-490e-4961-b7c3-9e08092e06a5-kube-api-access-z2xx8\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141334 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-etc-kubernetes\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141369 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-modprobe-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141390 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-conf\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141412 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-slash\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.142952 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141433 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a613faa-490e-4961-b7c3-9e08092e06a5-serviceca\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141456 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-conf-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141482 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141639 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-dbus\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141689 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-host\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141745 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa00b791-7a56-4038-83d2-e0f512626697-host-slash\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141767 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141792 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-bin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141809 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141818 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-hostroot\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141855 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-hostroot\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141871 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-netns\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141901 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-bin\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141900 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141935 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141938 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa00b791-7a56-4038-83d2-e0f512626697-iptables-alerter-script\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141957 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-sys\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.143738 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.141982 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-device-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142022 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-registration-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142025 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-sys-fs\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142067 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnbj\" (UniqueName: \"kubernetes.io/projected/7d0598da-23a6-4111-a3f1-f8e90c53674a-kube-api-access-zcnbj\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142099 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142153 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysconfig\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142230 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-tmp-dir\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142070 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-sys-fs\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142344 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-etc-kubernetes\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142390 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-host\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142408 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142418 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-modprobe-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142441 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa00b791-7a56-4038-83d2-e0f512626697-host-slash\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142487 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-bin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142500 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-slash\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142523 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-conf\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142523 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144348 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142551 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-sys\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142581 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-conf-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142583 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-cni-binary-copy\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142616 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-netns\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142636 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142092 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-script-lib\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142666 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-device-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142680 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-var-lib-kubelet\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142705 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-socket-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142749 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142776 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6rg\" (UniqueName: \"kubernetes.io/projected/b5d62fac-0db6-4150-b580-cc42eac91fb1-kube-api-access-vt6rg\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142776 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-script-lib\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142788 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-var-lib-kubelet\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142799 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a613faa-490e-4961-b7c3-9e08092e06a5-host\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142830 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142841 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-dbus\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142841 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.144946 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142881 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98pm7\" (UniqueName: \"kubernetes.io/projected/0e2f926b-3781-439c-b532-ba54972d6b9f-kube-api-access-98pm7\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142908 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-lib-modules\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142923 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a613faa-490e-4961-b7c3-9e08092e06a5-serviceca\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142930 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-socket-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142931 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-systemd-units\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142964 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-systemd-units\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142968 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-ovn\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142986 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a613faa-490e-4961-b7c3-9e08092e06a5-host\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.142993 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-env-overrides\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143027 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-ovn\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143054 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143076 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-lib-modules\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143076 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-run\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143111 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-run\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143176 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143268 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.143337 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-env-overrides\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.144305 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2bd8658-22fb-4aa8-a657-a363578881a8-agent-certs\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.145412 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.144307 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovn-node-metrics-cert\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.145899 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.144572 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-tmp\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.145899 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.144626 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-tuned\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.174629 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.174162 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 12:56:25.174629 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.174182 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 12:56:25.174629 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.174198 2539 projected.go:196] Error preparing data for projected volume kube-api-access-svxhp for pod openshift-network-diagnostics/network-check-target-ng2cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:25.174629 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:25.174253 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp podName:ad20dd74-53df-4aff-9c3b-08e4e4d30177 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:25.674236256 +0000 UTC m=+2.169887476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-svxhp" (UniqueName: "kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp") pod "network-check-target-ng2cv" (UID: "ad20dd74-53df-4aff-9c3b-08e4e4d30177") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:25.177028 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.176992 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfsm\" (UniqueName: \"kubernetes.io/projected/d6a229d1-9609-403c-bde5-1e6238304859-kube-api-access-5tfsm\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.177121 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.177094 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xx8\" (UniqueName: \"kubernetes.io/projected/6a613faa-490e-4961-b7c3-9e08092e06a5-kube-api-access-z2xx8\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.177174 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.177115 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnbj\" (UniqueName: \"kubernetes.io/projected/7d0598da-23a6-4111-a3f1-f8e90c53674a-kube-api-access-zcnbj\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.177803 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.177772 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q4ff\" (UniqueName: \"kubernetes.io/projected/aa00b791-7a56-4038-83d2-e0f512626697-kube-api-access-4q4ff\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:25.177904 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.177813 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcctp\" (UniqueName: \"kubernetes.io/projected/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-kube-api-access-zcctp\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.177904 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.177852 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98pm7\" (UniqueName: \"kubernetes.io/projected/0e2f926b-3781-439c-b532-ba54972d6b9f-kube-api-access-98pm7\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:25.178015 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.177904 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2sl\" (UniqueName: \"kubernetes.io/projected/74918493-bf14-4a8f-a407-14cdbb526a92-kube-api-access-dg2sl\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:25.178236 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.178213 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6rg\" (UniqueName: \"kubernetes.io/projected/b5d62fac-0db6-4150-b580-cc42eac91fb1-kube-api-access-vt6rg\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:25.178569 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.178553 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwj9\" (UniqueName: \"kubernetes.io/projected/c1568d95-34ae-46fc-8bdf-7a8918cf3973-kube-api-access-wvwj9\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.278742 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.278706 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zp996" Oct 30 12:56:25.283806 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.283789 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nkmrf" Oct 30 12:56:25.288287 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.288267 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a613faa_490e_4961_b7c3_9e08092e06a5.slice/crio-d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a WatchSource:0}: Error finding container d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a: Status 404 returned error can't find the container with id d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a Oct 30 12:56:25.293045 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.293028 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a229d1_9609_403c_bde5_1e6238304859.slice/crio-e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b WatchSource:0}: Error finding container e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b: Status 404 returned error can't find the container with id e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b Oct 30 12:56:25.309181 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.309158 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:25.313765 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.313752 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fghs2" Oct 30 12:56:25.318207 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.318183 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2bd8658_22fb_4aa8_a657_a363578881a8.slice/crio-e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902 WatchSource:0}: Error finding container e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902: Status 404 returned error can't find the container with id e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902 Oct 30 12:56:25.321867 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.321849 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6f7a0c_5e71_45a1_9eea_e1e1475a3d23.slice/crio-7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9 WatchSource:0}: Error finding container 7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9: Status 404 returned error can't find the container with id 7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9 Oct 30 12:56:25.330984 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.330968 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:56:25.339511 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.339493 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1568d95_34ae_46fc_8bdf_7a8918cf3973.slice/crio-5e636149f8aa60bb076d389044835fd87395e133aa28c7dec38ca67656d232e8 WatchSource:0}: Error finding container 5e636149f8aa60bb076d389044835fd87395e133aa28c7dec38ca67656d232e8: Status 404 returned error can't find the container with id 5e636149f8aa60bb076d389044835fd87395e133aa28c7dec38ca67656d232e8 Oct 30 12:56:25.352484 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:25.352466 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:56:25.360947 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:25.360929 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0598da_23a6_4111_a3f1_f8e90c53674a.slice/crio-a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632 WatchSource:0}: Error finding container a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632: Status 404 returned error can't find the container with id a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632 Oct 30 12:56:26.729883 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:26.729865 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:56:26.733493 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:26.733362 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:56:26.741547 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:26.741526 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa00b791_7a56_4038_83d2_e0f512626697.slice/crio-1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100 WatchSource:0}: Error finding container 1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100: Status 404 returned error can't find the container with id 1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100 Oct 30 12:56:26.743641 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:26.743623 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2f926b_3781_439c_b532_ba54972d6b9f.slice/crio-7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d WatchSource:0}: Error finding container 7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d: Status 404 returned error can't find the container with id 7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d Oct 30 12:56:26.749672 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:26.749653 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:26.758357 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:26.758338 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d62fac_0db6_4150_b580_cc42eac91fb1.slice/crio-c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35 WatchSource:0}: Error finding container c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35: Status 404 returned error can't find the container with id c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35 Oct 30 12:56:26.786189 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:26.786167 2539 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:56:26.862282 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:26.862253 2539 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:56:27.000235 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.000148 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:27.000235 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.000221 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:27.000406 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.000342 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:27.000406 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.000346 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:27.000406 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.000397 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:28.000384012 +0000 UTC m=+3.141563783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:27.000522 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.000412 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret podName:774297e4-0a5c-458f-8d10-ecffd469fce1 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:28.000405608 +0000 UTC m=+3.141585368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret") pod "global-pull-secret-syncer-gwd9f" (UID: "774297e4-0a5c-458f-8d10-ecffd469fce1") : object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:27.035331 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.035308 2539 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:56:27.101380 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.101313 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:27.101578 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.101543 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 12:56:27.101578 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.101573 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 12:56:27.101707 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.101585 2539 projected.go:196] Error preparing data for projected volume kube-api-access-svxhp for pod openshift-network-diagnostics/network-check-target-ng2cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:27.101707 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.101649 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp podName:ad20dd74-53df-4aff-9c3b-08e4e4d30177 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:28.1016294 +0000 UTC m=+3.242809161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-svxhp" (UniqueName: "kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp") pod "network-check-target-ng2cv" (UID: "ad20dd74-53df-4aff-9c3b-08e4e4d30177") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:27.346594 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.346480 2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 12:51:26 +0000 UTC" deadline="2028-04-01 13:47:03.947058783 +0000 UTC" Oct 30 12:56:27.346594 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.346542 2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12456h50m36.600520689s" Oct 30 12:56:27.431490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.431460 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:27.431679 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:27.431601 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:27.448618 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.448583 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnn4j" event={"ID":"f2bd8658-22fb-4aa8-a657-a363578881a8","Type":"ContainerStarted","Data":"e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902"} Oct 30 12:56:27.453463 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.453421 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nkmrf" event={"ID":"d6a229d1-9609-403c-bde5-1e6238304859","Type":"ContainerStarted","Data":"e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b"} Oct 30 12:56:27.466857 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.466827 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zp996" event={"ID":"6a613faa-490e-4961-b7c3-9e08092e06a5","Type":"ContainerStarted","Data":"d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a"} Oct 30 12:56:27.489493 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.489384 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" event={"ID":"ed215bcf2fbe8974076cda59d8c09a02","Type":"ContainerStarted","Data":"0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3"} Oct 30 12:56:27.495812 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.495708 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35"} Oct 30 12:56:27.521253 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.520128 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerStarted","Data":"7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d"} Oct 30 12:56:27.548242 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.548167 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s4z5v" event={"ID":"aa00b791-7a56-4038-83d2-e0f512626697","Type":"ContainerStarted","Data":"1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100"} Oct 30 12:56:27.576274 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.576244 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" event={"ID":"7d0598da-23a6-4111-a3f1-f8e90c53674a","Type":"ContainerStarted","Data":"a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632"} Oct 30 12:56:27.591749 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.591715 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7trc" event={"ID":"c1568d95-34ae-46fc-8bdf-7a8918cf3973","Type":"ContainerStarted","Data":"5e636149f8aa60bb076d389044835fd87395e133aa28c7dec38ca67656d232e8"} Oct 30 12:56:27.607606 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:27.607532 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fghs2" event={"ID":"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23","Type":"ContainerStarted","Data":"7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9"} Oct 30 12:56:28.010573 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.009780 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:28.010573 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.009874 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:28.010573 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.009993 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:28.010573 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.010051 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:30.010033393 +0000 UTC m=+5.151213166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:28.010573 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.010454 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:28.010573 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.010504 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret podName:774297e4-0a5c-458f-8d10-ecffd469fce1 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:30.01048974 +0000 UTC m=+5.151669519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret") pod "global-pull-secret-syncer-gwd9f" (UID: "774297e4-0a5c-458f-8d10-ecffd469fce1") : object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:28.110911 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.110873 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:28.111118 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.111102 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 12:56:28.111158 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.111126 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 12:56:28.111158 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.111139 2539 projected.go:196] Error preparing data for projected volume kube-api-access-svxhp for pod openshift-network-diagnostics/network-check-target-ng2cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:28.111265 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.111213 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp podName:ad20dd74-53df-4aff-9c3b-08e4e4d30177 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:30.111179456 +0000 UTC m=+5.252359239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-svxhp" (UniqueName: "kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp") pod "network-check-target-ng2cv" (UID: "ad20dd74-53df-4aff-9c3b-08e4e4d30177") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:28.347945 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.347529 2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 12:51:26 +0000 UTC" deadline="2028-07-26 13:00:22.074935224 +0000 UTC" Oct 30 12:56:28.347945 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.347588 2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15240h3m53.727351495s" Oct 30 12:56:28.430160 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.428952 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:28.430160 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.429073 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:28.430160 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:28.429468 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:28.430160 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:28.429555 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:29.431444 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:29.431412 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:29.431991 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:29.431557 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:30.027009 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.026983 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:30.027214 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.027017 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:30.027214 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.027116 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:30.027214 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.027163 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret podName:774297e4-0a5c-458f-8d10-ecffd469fce1 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:34.027150665 +0000 UTC m=+9.168330438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret") pod "global-pull-secret-syncer-gwd9f" (UID: "774297e4-0a5c-458f-8d10-ecffd469fce1") : object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:30.027396 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.027310 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:30.027396 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.027349 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:34.027337651 +0000 UTC m=+9.168517423 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:30.127823 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.127785 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:30.127992 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.127950 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 12:56:30.127992 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.127972 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 12:56:30.127992 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.127986 2539 projected.go:196] Error preparing data for projected volume kube-api-access-svxhp for pod openshift-network-diagnostics/network-check-target-ng2cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:30.128151 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.128044 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp podName:ad20dd74-53df-4aff-9c3b-08e4e4d30177 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:34.12802775 +0000 UTC m=+9.269207526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-svxhp" (UniqueName: "kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp") pod "network-check-target-ng2cv" (UID: "ad20dd74-53df-4aff-9c3b-08e4e4d30177") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:30.429048 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.428838 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:30.429180 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.429152 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:30.429267 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.429238 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:30.429342 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:30.429316 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:30.636503 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.636435 2539 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="08abd9cb15a689237b7974d003d7a5cb8b8ecb4d2628be69801161e8e2d26f12" exitCode=0 Oct 30 12:56:30.636967 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.636532 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerDied","Data":"08abd9cb15a689237b7974d003d7a5cb8b8ecb4d2628be69801161e8e2d26f12"} Oct 30 12:56:30.644827 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.644126 2539 generic.go:356] "Generic (PLEG): container finished" podID="92414930f024c1b0c2c5fc6bf0ad88b7" containerID="cba40d65017f682953f759bf397b6be32966ca300634be3cd803ca8d4d2423ad" exitCode=0 Oct 30 12:56:30.644827 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.644231 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"92414930f024c1b0c2c5fc6bf0ad88b7","Type":"ContainerDied","Data":"cba40d65017f682953f759bf397b6be32966ca300634be3cd803ca8d4d2423ad"} Oct 30 12:56:30.649266 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.648161 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" event={"ID":"ed215bcf2fbe8974076cda59d8c09a02","Type":"ContainerStarted","Data":"a475466cc857230a10acf1d16fb3a06c14c9ed24506a633638003ac50a3b403d"} Oct 30 12:56:30.769027 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:30.768973 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" podStartSLOduration=5.768957519 podStartE2EDuration="5.768957519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:30.76830085 +0000 UTC m=+5.909480636" watchObservedRunningTime="2026-10-30 12:56:30.768957519 +0000 UTC m=+5.910137302" Oct 30 12:56:31.431333 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:31.431283 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:31.431491 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:31.431425 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:31.659117 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:31.659080 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"92414930f024c1b0c2c5fc6bf0ad88b7","Type":"ContainerStarted","Data":"86d3aa5b801750f1f682c3687f6356ad0fbfa40832016770294e7a70e1ceb38d"} Oct 30 12:56:31.665010 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:31.664984 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnn4j" event={"ID":"f2bd8658-22fb-4aa8-a657-a363578881a8","Type":"ContainerStarted","Data":"b9955669812ee227c100c1117c80071fa1b49a8b9dda650c41cbd99b3c60b636"} Oct 30 12:56:31.744187 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:31.744091 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" podStartSLOduration=6.744072683 podStartE2EDuration="6.744072683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:31.701918972 +0000 UTC m=+6.843098753" watchObservedRunningTime="2026-10-30 12:56:31.744072683 +0000 UTC m=+6.885252465" Oct 30 12:56:32.429772 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:32.429061 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:32.429772 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:32.429217 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:32.429772 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:32.429623 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:32.429772 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:32.429719 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:32.670964 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:32.670632 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zp996" event={"ID":"6a613faa-490e-4961-b7c3-9e08092e06a5","Type":"ContainerStarted","Data":"25de23596444616902961650ed0d9a54146ad3291e8494f165450197b081d17b"} Oct 30 12:56:32.713127 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:32.713069 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zp996" podStartSLOduration=2.165452829 podStartE2EDuration="7.713049832s" totalImagesPullingTime="5.547597003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:32.712603784 +0000 UTC m=+7.853783578" watchObservedRunningTime="2026-10-30 12:56:32.713049832 +0000 UTC m=+7.854229616" Oct 30 12:56:32.713328 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:32.713295 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fnn4j" podStartSLOduration=3.403911892 podStartE2EDuration="7.71328758s" totalImagesPullingTime="4.309375688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:31.74523156 +0000 UTC m=+6.886411340" watchObservedRunningTime="2026-10-30 12:56:32.71328758 +0000 UTC m=+7.854467363" Oct 30 12:56:33.430134 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:33.430105 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:33.430329 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:33.430229 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:33.682180 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:33.682104 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" event={"ID":"7d0598da-23a6-4111-a3f1-f8e90c53674a","Type":"ContainerStarted","Data":"5550c7f439089f5cea3ed3d50b3462ede5f3348539b4d78033fe04b690b5bed5"} Oct 30 12:56:34.066666 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.066585 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:34.066666 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.066647 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:34.066888 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.066791 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:34.066888 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.066861 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret podName:774297e4-0a5c-458f-8d10-ecffd469fce1 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:42.066839921 +0000 UTC m=+17.208019694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret") pod "global-pull-secret-syncer-gwd9f" (UID: "774297e4-0a5c-458f-8d10-ecffd469fce1") : object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:34.067000 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.066934 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:34.067000 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.066975 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:42.066962456 +0000 UTC m=+17.208142219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:34.168383 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.168341 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:34.168583 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.168562 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 12:56:34.168656 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.168595 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 12:56:34.168656 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.168608 2539 projected.go:196] Error preparing data for projected volume kube-api-access-svxhp for pod openshift-network-diagnostics/network-check-target-ng2cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:34.168752 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.168665 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp podName:ad20dd74-53df-4aff-9c3b-08e4e4d30177 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:42.16864648 +0000 UTC m=+17.309826259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-svxhp" (UniqueName: "kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp") pod "network-check-target-ng2cv" (UID: "ad20dd74-53df-4aff-9c3b-08e4e4d30177") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:34.317099 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.316850 2539 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 12:56:34.356268 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.355655 2539 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T12:56:34.31686529Z","UUID":"c797c68b-d344-4026-9edb-ab424a40b302","Handler":null,"Name":"","Endpoint":""} Oct 30 12:56:34.357609 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.357160 2539 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 12:56:34.357609 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.357192 2539 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 12:56:34.428726 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.428695 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:34.428870 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.428809 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:34.428945 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.428865 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:34.429009 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:34.428981 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:34.688549 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:34.688510 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" event={"ID":"7d0598da-23a6-4111-a3f1-f8e90c53674a","Type":"ContainerStarted","Data":"2593ba9575ce09836fdce204777ab9c88ce50450d1e9213e0886b439156cdaac"} Oct 30 12:56:35.429284 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.429251 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:35.429428 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:35.429390 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:35.693749 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.693705 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" event={"ID":"7d0598da-23a6-4111-a3f1-f8e90c53674a","Type":"ContainerStarted","Data":"e2937a6cb3ab88386e10f79fe11e8f4433898c681502e6a57e937ea2266c8fb1"} Oct 30 12:56:35.696267 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.695916 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fghs2" event={"ID":"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23","Type":"ContainerStarted","Data":"4fcb4bb9fb45589654e204b582dd350616e1c09f4b8f398f7ed5f64348bc6a4e"} Oct 30 12:56:35.697880 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.697843 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nkmrf" event={"ID":"d6a229d1-9609-403c-bde5-1e6238304859","Type":"ContainerStarted","Data":"43e7594d18481b3c376963856a70a7c510b08fcd47c05fecaebbd1c8061c988c"} Oct 30 12:56:35.700298 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.700266 2539 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="7b5e5be90e18861a78454aa5e525914e2a914b4fde708c2f225fd7ac4467afa7" exitCode=0 Oct 30 12:56:35.700392 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.700299 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerDied","Data":"7b5e5be90e18861a78454aa5e525914e2a914b4fde708c2f225fd7ac4467afa7"} Oct 30 12:56:35.750906 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.750853 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" podStartSLOduration=2.444282434 podStartE2EDuration="10.750839549s" totalImagesPullingTime="8.306557115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:35.75025129 +0000 UTC m=+10.891431072" watchObservedRunningTime="2026-10-30 12:56:35.750839549 +0000 UTC m=+10.892019329" Oct 30 12:56:35.797052 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.796957 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-nkmrf" podStartSLOduration=2.696091288 podStartE2EDuration="10.796941144s" totalImagesPullingTime="8.100849856s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:35.796024452 +0000 UTC m=+10.937204246" watchObservedRunningTime="2026-10-30 12:56:35.796941144 +0000 UTC m=+10.938120927" Oct 30 12:56:35.809571 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.809542 2539 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:35.810606 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.810575 2539 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:35.838056 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:35.838004 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-fghs2" podStartSLOduration=2.41693064 podStartE2EDuration="10.837985171s" totalImagesPullingTime="8.421054531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:35.837302753 +0000 UTC m=+10.978482537" watchObservedRunningTime="2026-10-30 12:56:35.837985171 +0000 UTC m=+10.979164953" Oct 30 12:56:36.431758 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:36.431727 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:36.431880 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:36.431849 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:36.432284 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:36.432259 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:36.432385 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:36.432372 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:36.705257 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:36.705222 2539 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="6d40ae9a4e25f1375ea4d3588d83235b17f0648b576f775c2ffbd5793431746c" exitCode=0 Oct 30 12:56:36.705658 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:36.705359 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerDied","Data":"6d40ae9a4e25f1375ea4d3588d83235b17f0648b576f775c2ffbd5793431746c"} Oct 30 12:56:36.706913 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:36.706813 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:36.707308 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:36.707289 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:56:37.429414 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.429163 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:37.429583 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:37.429541 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:37.710031 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.709949 2539 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="438d7c100a59617d7781f0c2647d517db83ab1a62785101c270aea48760a2a8c" exitCode=0 Oct 30 12:56:37.710031 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.710007 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerDied","Data":"438d7c100a59617d7781f0c2647d517db83ab1a62785101c270aea48760a2a8c"} Oct 30 12:56:37.711835 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.711812 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s4z5v" event={"ID":"aa00b791-7a56-4038-83d2-e0f512626697","Type":"ContainerStarted","Data":"144e5c745de95746ba673dce32d78b6386710608611165110165bf7469ed50e0"} Oct 30 12:56:37.713352 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.713328 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7trc" event={"ID":"c1568d95-34ae-46fc-8bdf-7a8918cf3973","Type":"ContainerStarted","Data":"9de7112756693ad71373a5fb7e4c8dd69b0c93720a60ab3f290640c2611ddf70"} Oct 30 12:56:37.815240 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.815177 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s4z5v" podStartSLOduration=4.253889417 podStartE2EDuration="12.815165177s" totalImagesPullingTime="8.56127576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:37.815022091 +0000 UTC m=+12.956201873" watchObservedRunningTime="2026-10-30 12:56:37.815165177 +0000 UTC m=+12.956344959" Oct 30 12:56:37.860511 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:37.860444 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s7trc" podStartSLOduration=2.66657304 podStartE2EDuration="12.860422411s" totalImagesPullingTime="10.193849371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:37.86039274 +0000 UTC m=+13.001572522" watchObservedRunningTime="2026-10-30 12:56:37.860422411 +0000 UTC m=+13.001602195" Oct 30 12:56:38.428744 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:38.428710 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:38.428744 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:38.428754 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:38.428958 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:38.428838 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:38.429022 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:38.428987 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:39.428933 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:39.428909 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:39.429495 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:39.429034 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:39.720533 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:39.720499 2539 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="24a595f6436821e047f87b1bcb4e94dbe08a4815e94da6109af5a1918c57f2a0" exitCode=0 Oct 30 12:56:39.720703 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:39.720547 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerDied","Data":"24a595f6436821e047f87b1bcb4e94dbe08a4815e94da6109af5a1918c57f2a0"} Oct 30 12:56:40.428685 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:40.428654 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:40.428685 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:40.428690 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:40.428906 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:40.428802 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:40.428906 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:40.428885 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:40.727179 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:40.727143 2539 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="a09635b090525dd172688cd2b9e2c0923bbc398c6519ebbcd9557a64fe2a00a2" exitCode=0 Oct 30 12:56:40.727383 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:40.727212 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerDied","Data":"a09635b090525dd172688cd2b9e2c0923bbc398c6519ebbcd9557a64fe2a00a2"} Oct 30 12:56:41.429508 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.429291 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:41.429793 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:41.429628 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:41.733608 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.733563 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" event={"ID":"0e2f926b-3781-439c-b532-ba54972d6b9f","Type":"ContainerStarted","Data":"3946c983e28a0bf229d5f910e0a4a3d2c85d6ebd1f6328d58cc24d567769f247"} Oct 30 12:56:41.735490 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.735471 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:56:41.735810 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.735791 2539 generic.go:356] "Generic (PLEG): container finished" podID="b5d62fac-0db6-4150-b580-cc42eac91fb1" containerID="98bd1fcc25389dd856fb0e78f186b2200a75a3988e56e71c1b0866ac7b59a954" exitCode=1 Oct 30 12:56:41.735885 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.735820 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"bebc88f7955b2bdbc1d14ca80251adf6cf0952dca6044577a86a4916d0bbf0fa"} Oct 30 12:56:41.735885 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.735869 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"3721d55112ab60569925c6dee83ce1eee1b06ee8e360f86ffc39760d100511c5"} Oct 30 12:56:41.735947 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.735900 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerDied","Data":"98bd1fcc25389dd856fb0e78f186b2200a75a3988e56e71c1b0866ac7b59a954"} Oct 30 12:56:41.735947 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.735929 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"1c6a8c850dc229dda594f0922ce83f509b8360a0ebd5b0d2d8064cc3429cbc56"} Oct 30 12:56:41.809841 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:41.809799 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kcqr7" podStartSLOduration=6.526134227 podStartE2EDuration="16.809787513s" totalImagesPullingTime="10.283653286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:41.80954459 +0000 UTC m=+16.950724372" watchObservedRunningTime="2026-10-30 12:56:41.809787513 +0000 UTC m=+16.950967294" Oct 30 12:56:42.136626 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.136428 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:42.136801 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.136641 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:42.136801 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.136580 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:42.136801 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.136749 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:58.136732907 +0000 UTC m=+33.277912668 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 30 12:56:42.136801 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.136763 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:42.136943 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.136806 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret podName:774297e4-0a5c-458f-8d10-ecffd469fce1 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:58.136790566 +0000 UTC m=+33.277970330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret") pod "global-pull-secret-syncer-gwd9f" (UID: "774297e4-0a5c-458f-8d10-ecffd469fce1") : object "kube-system"/"original-pull-secret" not registered Oct 30 12:56:42.237642 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.237611 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:42.237768 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.237748 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 30 12:56:42.237768 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.237763 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 30 12:56:42.237843 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.237773 2539 projected.go:196] Error preparing data for projected volume kube-api-access-svxhp for pod openshift-network-diagnostics/network-check-target-ng2cv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:42.237843 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.237817 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp podName:ad20dd74-53df-4aff-9c3b-08e4e4d30177 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:58.237805383 +0000 UTC m=+33.378985142 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-svxhp" (UniqueName: "kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp") pod "network-check-target-ng2cv" (UID: "ad20dd74-53df-4aff-9c3b-08e4e4d30177") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 30 12:56:42.428355 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.428283 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:42.428473 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.428290 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:42.428473 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.428402 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:42.428473 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:42.428443 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:42.740267 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.740241 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:56:42.740690 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.740626 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"8358b79db444ac0207df3e73cf42bb4a3d4bb9b06f25aa6906d706055427c736"} Oct 30 12:56:42.740767 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:42.740741 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"7107c42fcf95b100bad7c332a5777e3d85d789e700315aa9c29ff5f5b1707c7e"} Oct 30 12:56:43.429027 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:43.428998 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:43.429177 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:43.429133 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:44.428853 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:44.428819 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:44.429290 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:44.428947 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:44.429290 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:44.428996 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:44.429290 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:44.429061 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:44.748265 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:44.748243 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:56:44.748587 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:44.748566 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"d8457702445d01290bce4e99ee35042c4d6a228e34c073127e6939de8c318367"} Oct 30 12:56:45.429639 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:45.429609 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:45.430083 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:45.429693 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:46.428435 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.428359 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:46.428435 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.428391 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:46.428605 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:46.428492 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:46.428710 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:46.428689 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:46.755256 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.755231 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:56:46.755934 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.755575 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"feb6af8a6988fa0030588c9668827ff826fee2ec83ebc3de43608e41e6054bcb"} Oct 30 12:56:46.755934 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.755837 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:46.755934 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.755887 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:46.756100 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.756005 2539 scope.go:122] "RemoveContainer" containerID="98bd1fcc25389dd856fb0e78f186b2200a75a3988e56e71c1b0866ac7b59a954" Oct 30 12:56:46.772439 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:46.772421 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:47.429295 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:47.429262 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:47.429530 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:47.429378 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:47.762248 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:47.762159 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:56:47.762716 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:47.762565 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" event={"ID":"b5d62fac-0db6-4150-b580-cc42eac91fb1","Type":"ContainerStarted","Data":"70b85ea54aa47f6b715acbba9bfb4d03df89078870dd9e0a6b1c92e98a410167"} Oct 30 12:56:47.762806 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:47.762784 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:47.778321 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:47.778298 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:56:47.860070 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:47.859896 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" podStartSLOduration=8.26062403 podStartE2EDuration="22.859882494s" totalImagesPullingTime="14.599258464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:47.845961253 +0000 UTC m=+22.987141033" watchObservedRunningTime="2026-10-30 12:56:47.859882494 +0000 UTC m=+23.001062274" Oct 30 12:56:48.079212 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:48.079101 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gwd9f"] Oct 30 12:56:48.079341 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:48.079234 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:48.079341 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:48.079315 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:48.083525 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:48.083500 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ng2cv"] Oct 30 12:56:48.083649 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:48.083614 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:48.083742 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:48.083719 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:48.085534 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:48.085514 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wxdwb"] Oct 30 12:56:48.085689 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:48.085585 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:48.085689 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:48.085668 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:49.428581 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:49.428545 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:49.428983 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:49.428661 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:50.429172 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:50.429094 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:50.429172 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:50.429115 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:50.429577 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:50.429242 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:50.429577 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:50.429273 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:51.429107 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:51.429073 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:51.429296 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:51.429218 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:52.428369 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:52.428281 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:52.428538 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:52.428291 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:52.428538 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:52.428394 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gwd9f" podUID="774297e4-0a5c-458f-8d10-ecffd469fce1" Oct 30 12:56:52.428538 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:52.428478 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxdwb" podUID="74918493-bf14-4a8f-a407-14cdbb526a92" Oct 30 12:56:53.428362 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.428274 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:53.428831 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:53.428375 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ng2cv" podUID="ad20dd74-53df-4aff-9c3b-08e4e4d30177" Oct 30 12:56:53.649116 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.649081 2539 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeReady" Oct 30 12:56:53.649299 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.649240 2539 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Oct 30 12:56:53.718373 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.718339 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p4cbf"] Oct 30 12:56:53.721481 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.721460 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.722394 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.722376 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lxnch"] Oct 30 12:56:53.725499 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.725476 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.754578 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.754554 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-sdfnl\"" Oct 30 12:56:53.757336 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.757315 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 12:56:53.757619 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.757587 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 12:56:53.757780 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.757636 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 12:56:53.757780 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.757679 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 12:56:53.759645 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.759625 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p4cbf"] Oct 30 12:56:53.760264 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.760247 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxnch"] Oct 30 12:56:53.768252 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.768237 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 12:56:53.814517 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.814493 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-tmp-dir\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.814661 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.814526 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09d8584-bdfc-427f-83fe-5fd6e197c315-cert\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.814661 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.814546 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9r6d\" (UniqueName: \"kubernetes.io/projected/a09d8584-bdfc-427f-83fe-5fd6e197c315-kube-api-access-j9r6d\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.814661 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.814635 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.814773 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.814714 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmv9b\" (UniqueName: \"kubernetes.io/projected/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-kube-api-access-tmv9b\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.814773 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.814737 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-config-volume\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.854495 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.854464 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bbfv\"" Oct 30 12:56:53.915929 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.915888 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09d8584-bdfc-427f-83fe-5fd6e197c315-cert\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.915929 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.915923 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9r6d\" (UniqueName: \"kubernetes.io/projected/a09d8584-bdfc-427f-83fe-5fd6e197c315-kube-api-access-j9r6d\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.916155 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.916135 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.916232 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.916168 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmv9b\" (UniqueName: \"kubernetes.io/projected/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-kube-api-access-tmv9b\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.916232 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.916189 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-config-volume\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.916341 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.916250 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-tmp-dir\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.916341 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:53.916291 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:56:53.916436 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:53.916377 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:54.416355526 +0000 UTC m=+29.557535301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:56:53.916617 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.916591 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-tmp-dir\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.916797 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.916781 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-config-volume\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:53.919791 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.919767 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09d8584-bdfc-427f-83fe-5fd6e197c315-cert\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.944556 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.944536 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9r6d\" (UniqueName: \"kubernetes.io/projected/a09d8584-bdfc-427f-83fe-5fd6e197c315-kube-api-access-j9r6d\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:53.947960 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:53.947943 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmv9b\" (UniqueName: \"kubernetes.io/projected/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-kube-api-access-tmv9b\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:54.034169 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.034089 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:56:54.345123 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.344954 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p4cbf"] Oct 30 12:56:54.346562 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:54.346538 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09d8584_bdfc_427f_83fe_5fd6e197c315.slice/crio-3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7 WatchSource:0}: Error finding container 3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7: Status 404 returned error can't find the container with id 3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7 Oct 30 12:56:54.420302 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.420259 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:54.420466 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:54.420369 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:56:54.420466 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:54.420416 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:55.420403867 +0000 UTC m=+30.561583630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:56:54.428261 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.428235 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:54.428311 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.428263 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:54.444827 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.444809 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 12:56:54.445173 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.445132 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v4tv9\"" Oct 30 12:56:54.445256 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.445172 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-sqtw6\"" Oct 30 12:56:54.445256 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.445187 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 12:56:54.778376 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:54.778336 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p4cbf" event={"ID":"a09d8584-bdfc-427f-83fe-5fd6e197c315","Type":"ContainerStarted","Data":"3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7"} Oct 30 12:56:55.426508 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:55.426470 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:55.426736 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:55.426720 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:56:55.426819 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:55.426805 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:56:57.426786021 +0000 UTC m=+32.567965796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:56:55.433763 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:55.433739 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:55.451518 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:55.451495 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 12:56:55.451827 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:55.451524 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vg7bt\"" Oct 30 12:56:55.461623 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:55.461605 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 12:56:57.442619 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:57.442593 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:56:57.442985 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:57.442689 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:56:57.442985 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:57.442739 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:01.442727401 +0000 UTC m=+36.583907160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:56:57.786025 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:57.785949 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p4cbf" event={"ID":"a09d8584-bdfc-427f-83fe-5fd6e197c315","Type":"ContainerStarted","Data":"05e47737b8e482370f477440e3b782c1713f82fc3cfa53ce90af80435b359bae"} Oct 30 12:56:57.829705 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:57.829660 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p4cbf" podStartSLOduration=2.144905626 podStartE2EDuration="4.829648085s" totalImagesPullingTime="2.684742459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:56:57.828685313 +0000 UTC m=+32.969865093" watchObservedRunningTime="2026-10-30 12:56:57.829648085 +0000 UTC m=+32.970827887" Oct 30 12:56:58.147831 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.147798 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:56:58.147831 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.147836 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:58.148030 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:58.147954 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 12:56:58.148030 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:56:58.148023 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:30.148009042 +0000 UTC m=+65.289188812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : secret "metrics-daemon-secret" not found Oct 30 12:56:58.150662 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.150641 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:58.248788 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.248757 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:58.251235 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.251214 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:58.342353 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.342285 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:56:58.466592 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.466564 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:56:58.649319 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.649291 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gwd9f"] Oct 30 12:56:58.650152 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:58.650133 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774297e4_0a5c_458f_8d10_ecffd469fce1.slice/crio-e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b WatchSource:0}: Error finding container e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b: Status 404 returned error can't find the container with id e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b Oct 30 12:56:58.789055 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.789015 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gwd9f" event={"ID":"774297e4-0a5c-458f-8d10-ecffd469fce1","Type":"ContainerStarted","Data":"e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b"} Oct 30 12:56:58.792603 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:58.792585 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ng2cv"] Oct 30 12:56:58.793498 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:56:58.793475 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad20dd74_53df_4aff_9c3b_08e4e4d30177.slice/crio-5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a WatchSource:0}: Error finding container 5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a: Status 404 returned error can't find the container with id 5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a Oct 30 12:56:59.792895 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.792858 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ng2cv" event={"ID":"ad20dd74-53df-4aff-9c3b-08e4e4d30177","Type":"ContainerStarted","Data":"5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a"} Oct 30 12:56:59.921133 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.921086 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-95x2c"] Oct 30 12:56:59.943179 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.943148 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:56:59.963715 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.963681 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-95x2c"] Oct 30 12:56:59.987242 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.987188 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 12:56:59.987391 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.987356 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kmvh7\"" Oct 30 12:56:59.987682 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.987642 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 12:56:59.987935 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.987903 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 12:56:59.988610 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:56:59.988585 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 12:57:00.056356 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.056282 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-2j9r4-hrv7r"] Oct 30 12:57:00.065770 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.065735 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4329ebd9-15fd-450a-8097-cc310c4cff77-data-volume\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.065905 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.065803 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.065905 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.065830 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zgqp\" (UniqueName: \"kubernetes.io/projected/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-api-access-8zgqp\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.065905 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.065859 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.066067 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.065921 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4329ebd9-15fd-450a-8097-cc310c4cff77-crio-socket\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.077557 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.077531 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.084611 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.084588 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-2j9r4-hrv7r"] Oct 30 12:57:00.095608 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.095587 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rlrpr\"" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167056 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167094 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zgqp\" (UniqueName: \"kubernetes.io/projected/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-api-access-8zgqp\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167122 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167154 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167187 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167236 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.167281 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.167236 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.167297 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.167339 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:00.667318703 +0000 UTC m=+35.808498476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.167377 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:00.66735905 +0000 UTC m=+35.808538832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : configmap "kube-rbac-proxy" not found Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167470 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4329ebd9-15fd-450a-8097-cc310c4cff77-crio-socket\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167492 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167529 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4329ebd9-15fd-450a-8097-cc310c4cff77-data-volume\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.167734 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167694 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4329ebd9-15fd-450a-8097-cc310c4cff77-crio-socket\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.167949 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.167780 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4329ebd9-15fd-450a-8097-cc310c4cff77-data-volume\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.170535 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.170514 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 12:57:00.198942 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.198905 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 12:57:00.202141 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.202107 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zgqp\" (UniqueName: \"kubernetes.io/projected/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-api-access-8zgqp\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.268668 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.268171 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.268668 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.268333 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.268668 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.268369 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.268668 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.268402 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.268919 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.268883 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.269080 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.269060 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.269186 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.269130 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.297259 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.297229 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.328109 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.327131 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-4hnkf"] Oct 30 12:57:00.350797 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.350148 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.357263 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.357242 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-4hnkf"] Oct 30 12:57:00.369060 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.369030 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 12:57:00.369169 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.369090 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 12:57:00.369169 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.369126 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fslsc\"" Oct 30 12:57:00.369169 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.369166 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 12:57:00.369354 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.369230 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 12:57:00.403753 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.403723 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:00.469996 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.469898 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-key\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.469996 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.469940 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-cabundle\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.469996 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.469970 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcch7\" (UniqueName: \"kubernetes.io/projected/edecf660-2fb4-4fca-8663-c4bbbe986486-kube-api-access-gcch7\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.509717 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.509693 2539 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7"] Oct 30 12:57:00.526877 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.526853 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:00.537093 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.537049 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7"] Oct 30 12:57:00.547376 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.547349 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 12:57:00.547376 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.547367 2539 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wf8rx\"" Oct 30 12:57:00.547546 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.547435 2539 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 12:57:00.570836 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.570811 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-key\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.570977 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.570842 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-cabundle\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.570977 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.570861 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcch7\" (UniqueName: \"kubernetes.io/projected/edecf660-2fb4-4fca-8663-c4bbbe986486-kube-api-access-gcch7\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.571806 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.571779 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-cabundle\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.574132 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.574108 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-key\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.611341 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.611282 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcch7\" (UniqueName: \"kubernetes.io/projected/edecf660-2fb4-4fca-8663-c4bbbe986486-kube-api-access-gcch7\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.672225 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.672181 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.672225 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.672237 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:00.672466 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.672272 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4jgl\" (UniqueName: \"kubernetes.io/projected/7c591670-192b-401e-898d-0a914a94e4bf-kube-api-access-j4jgl\") pod \"migrator-66df5d496b-72zx7\" (UID: \"7c591670-192b-401e-898d-0a914a94e4bf\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:00.672466 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.672368 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:00.672466 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.672390 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 12:57:00.672466 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.672451 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:01.672429871 +0000 UTC m=+36.813609648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:00.672617 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:00.672472 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:01.672461671 +0000 UTC m=+36.813641433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : configmap "kube-rbac-proxy" not found Oct 30 12:57:00.681189 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.681164 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:00.732933 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.731917 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-2j9r4-hrv7r"] Oct 30 12:57:00.773286 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.772991 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jgl\" (UniqueName: \"kubernetes.io/projected/7c591670-192b-401e-898d-0a914a94e4bf-kube-api-access-j4jgl\") pod \"migrator-66df5d496b-72zx7\" (UID: \"7c591670-192b-401e-898d-0a914a94e4bf\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:00.797172 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.797136 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" event={"ID":"62c000fd-3f35-44e1-8c56-dea1099fd496","Type":"ContainerStarted","Data":"69d40b18a793bccb5d73bacfbadb3398c238279e1867783f7dde903efefb1f7a"} Oct 30 12:57:00.801000 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.800977 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jgl\" (UniqueName: \"kubernetes.io/projected/7c591670-192b-401e-898d-0a914a94e4bf-kube-api-access-j4jgl\") pod \"migrator-66df5d496b-72zx7\" (UID: \"7c591670-192b-401e-898d-0a914a94e4bf\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:00.851237 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.851189 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:00.999520 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:00.999492 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-4hnkf"] Oct 30 12:57:01.000923 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:57:01.000883 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedecf660_2fb4_4fca_8663_c4bbbe986486.slice/crio-449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4 WatchSource:0}: Error finding container 449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4: Status 404 returned error can't find the container with id 449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4 Oct 30 12:57:01.184610 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:01.184584 2539 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7"] Oct 30 12:57:01.186127 ip-10-0-130-34 kubenswrapper[2539]: W1030 12:57:01.186100 2539 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c591670_192b_401e_898d_0a914a94e4bf.slice/crio-3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461 WatchSource:0}: Error finding container 3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461: Status 404 returned error can't find the container with id 3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461 Oct 30 12:57:01.479555 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:01.479468 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:01.479718 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:01.479642 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:57:01.479718 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:01.479706 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:09.479685823 +0000 UTC m=+44.620865605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:57:01.681461 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:01.680802 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:01.681461 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:01.680854 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:01.681461 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:01.680936 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 12:57:01.681461 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:01.680997 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:03.68097877 +0000 UTC m=+38.822158546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : configmap "kube-rbac-proxy" not found Oct 30 12:57:01.681461 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:01.681078 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:01.681461 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:01.681110 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:03.681099291 +0000 UTC m=+38.822279064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:01.804884 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:01.804803 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" event={"ID":"edecf660-2fb4-4fca-8663-c4bbbe986486","Type":"ContainerStarted","Data":"449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4"} Oct 30 12:57:01.806488 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:01.806099 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" event={"ID":"7c591670-192b-401e-898d-0a914a94e4bf","Type":"ContainerStarted","Data":"3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461"} Oct 30 12:57:02.811892 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:02.811096 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ng2cv" event={"ID":"ad20dd74-53df-4aff-9c3b-08e4e4d30177","Type":"ContainerStarted","Data":"8b62e0918a8df81886cbd20bcd27486be31801b2246f9a1ddc0b28284e33b873"} Oct 30 12:57:02.811892 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:02.811844 2539 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:57:02.855733 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:02.855674 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ng2cv" podStartSLOduration=33.987735256 podStartE2EDuration="37.855656256s" totalImagesPullingTime="3.867921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:02.855078336 +0000 UTC m=+37.996258130" watchObservedRunningTime="2026-10-30 12:57:02.855656256 +0000 UTC m=+37.996836037" Oct 30 12:57:03.697797 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:03.697749 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:03.698079 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:03.697808 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:03.698079 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:03.697921 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Oct 30 12:57:03.698079 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:03.697984 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:07.697964872 +0000 UTC m=+42.839144648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : configmap "kube-rbac-proxy" not found Oct 30 12:57:03.698411 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:03.698387 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:03.698498 ip-10-0-130-34 kubenswrapper[2539]: E1030 12:57:03.698447 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:07.698430087 +0000 UTC m=+42.839609865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:03.816105 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:03.816057 2539 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" event={"ID":"7c591670-192b-401e-898d-0a914a94e4bf","Type":"ContainerStarted","Data":"b27bee9af2f4d52c958b80a24301964521f4b179732af94a0ddc01794bf0b739"} Oct 30 12:57:03.859840 ip-10-0-130-34 kubenswrapper[2539]: I1030 12:57:03.859790 2539 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" podStartSLOduration=1.991432571 podStartE2EDuration="3.859775521s" totalImagesPullingTime="1.86834295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:03.858664168 +0000 UTC m=+38.999843948" watchObservedRunningTime="2026-10-30 12:57:03.859775521 +0000 UTC m=+39.000955305" Oct 30 12:57:04.709119 ip-10-0-130-34 systemd[1]: Stopping Kubernetes Kubelet... Oct 30 12:57:04.717691 ip-10-0-130-34 systemd[1]: kubelet.service: Deactivated successfully. Oct 30 12:57:04.717901 ip-10-0-130-34 systemd[1]: Stopped Kubernetes Kubelet. Oct 30 12:57:04.717963 ip-10-0-130-34 systemd[1]: kubelet.service: Consumed 2.371s CPU time. Oct 30 12:57:04.728708 ip-10-0-130-34 systemd[1]: Starting Kubernetes Kubelet... Oct 30 12:57:04.810029 ip-10-0-130-34 kubenswrapper[4498]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 12:57:04.810029 ip-10-0-130-34 kubenswrapper[4498]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 30 12:57:04.810029 ip-10-0-130-34 kubenswrapper[4498]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 12:57:04.810029 ip-10-0-130-34 kubenswrapper[4498]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812280 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812385 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812390 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812395 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812399 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812403 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812407 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812411 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812415 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812419 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812422 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812426 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812431 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812434 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812439 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812449 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812453 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812458 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812462 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.812952 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812466 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812470 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812474 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812479 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812483 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812487 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812491 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812495 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812500 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812504 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812508 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812514 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812519 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812524 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812528 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812533 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812537 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812540 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812544 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.813633 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812548 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812553 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812556 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812560 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812564 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812568 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812572 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812585 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812589 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812593 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812625 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812631 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812636 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812640 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812644 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812648 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812652 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812656 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812660 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812664 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.814096 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812672 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812676 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812682 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812689 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812695 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812699 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812704 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812708 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812712 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812716 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812720 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812724 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812728 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812731 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812735 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812739 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812743 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812747 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812751 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.814618 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812756 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812769 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812774 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812778 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812782 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812786 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812790 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812794 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812798 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812802 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812806 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812810 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812814 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812820 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812823 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812828 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812832 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812836 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812841 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.815117 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812845 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812849 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812852 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812856 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812860 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812864 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812868 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812872 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812876 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.812879 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814084 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814093 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814097 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814102 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814106 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814113 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814117 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814121 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814126 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814130 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.815596 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814134 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814138 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814142 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814146 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814151 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814156 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814161 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814165 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814169 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814173 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814177 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814181 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814185 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814189 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814212 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814216 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814220 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814224 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814228 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814232 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.816088 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814237 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814241 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814245 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814249 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814253 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814257 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814260 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814264 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814269 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814273 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814277 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814292 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814296 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814301 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814305 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814309 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814313 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814317 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814321 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.816594 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814326 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814330 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814334 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814338 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814342 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814346 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814350 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814354 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814358 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814362 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814366 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814370 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814376 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814379 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814383 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814387 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814391 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814395 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814399 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.817050 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814403 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814408 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814411 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814416 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814420 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814424 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814428 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814432 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814436 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814439 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814443 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814448 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814452 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814456 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814460 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814464 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814468 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814473 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814480 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.817709 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814486 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814490 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814494 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814498 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814502 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814506 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814510 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814514 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814518 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814524 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814529 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814534 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814538 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814542 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814548 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814552 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814556 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814561 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.814565 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.818190 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815335 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815342 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815346 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815350 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815354 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815359 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815364 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815368 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815372 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815376 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815380 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815384 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815388 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815392 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815396 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815400 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815404 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815408 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815412 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.818682 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815416 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815420 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815424 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815428 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815432 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815436 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815440 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815444 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815448 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815452 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815456 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815461 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815465 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815469 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815473 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815477 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815481 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815485 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815492 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815496 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.819154 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815500 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815504 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815508 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815512 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815516 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815520 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815524 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815528 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815532 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815536 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815540 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815544 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815548 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815552 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815556 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815560 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815564 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815569 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815573 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815577 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.819657 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815581 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815586 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815590 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815594 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815599 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815603 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815607 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815614 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815620 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815625 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815631 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815635 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815639 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815643 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815647 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815652 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815656 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815660 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815663 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.820138 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815668 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815672 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815676 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815680 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815684 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815688 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815692 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815698 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815703 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815708 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815713 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815718 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815722 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815727 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815731 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815735 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815740 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815744 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815748 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.820796 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815752 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815756 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815760 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815764 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815769 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815774 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815778 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815782 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.815786 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815919 4498 flags.go:64] FLAG: --address="0.0.0.0" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815933 4498 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815942 4498 flags.go:64] FLAG: --anonymous-auth="true" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815948 4498 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815955 4498 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815959 4498 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815966 4498 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815972 4498 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815976 4498 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815981 4498 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815986 4498 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815992 4498 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.815997 4498 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 30 12:57:04.821552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816001 4498 flags.go:64] FLAG: --cgroup-root="" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816005 4498 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816010 4498 flags.go:64] FLAG: --client-ca-file="" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816014 4498 flags.go:64] FLAG: --cloud-provider="external" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816021 4498 flags.go:64] FLAG: --cluster-dns="[]" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816027 4498 flags.go:64] FLAG: --cluster-domain="" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816031 4498 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816036 4498 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816041 4498 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816046 4498 flags.go:64] FLAG: --container-log-max-files="5" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816053 4498 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816057 4498 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816062 4498 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816067 4498 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816073 4498 flags.go:64] FLAG: --contention-profiling="false" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816078 4498 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816083 4498 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816088 4498 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816093 4498 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816099 4498 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816104 4498 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816109 4498 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816114 4498 flags.go:64] FLAG: --enable-load-reader="false" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816118 4498 flags.go:64] FLAG: --enable-server="true" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816123 4498 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 30 12:57:04.822262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816129 4498 flags.go:64] FLAG: --event-burst="100" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816134 4498 flags.go:64] FLAG: --event-qps="50" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816138 4498 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816143 4498 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816147 4498 flags.go:64] FLAG: --eviction-hard="" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816153 4498 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816158 4498 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816163 4498 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816167 4498 flags.go:64] FLAG: --eviction-soft="" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816173 4498 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816177 4498 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816183 4498 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816187 4498 flags.go:64] FLAG: --experimental-mounter-path="" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816209 4498 flags.go:64] FLAG: --fail-cgroupv1="true" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816214 4498 flags.go:64] FLAG: --fail-swap-on="true" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816219 4498 flags.go:64] FLAG: --feature-gates="" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816225 4498 flags.go:64] FLAG: --file-check-frequency="20s" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816230 4498 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816236 4498 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816240 4498 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816245 4498 flags.go:64] FLAG: --healthz-port="10248" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816250 4498 flags.go:64] FLAG: --help="false" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816254 4498 flags.go:64] FLAG: --hostname-override="ip-10-0-130-34.ec2.internal" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816259 4498 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 30 12:57:04.822883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816264 4498 flags.go:64] FLAG: --http-check-frequency="20s" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816268 4498 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816273 4498 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816278 4498 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816283 4498 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816287 4498 flags.go:64] FLAG: --image-service-endpoint="" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816291 4498 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816295 4498 flags.go:64] FLAG: --kube-api-burst="100" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816300 4498 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816304 4498 flags.go:64] FLAG: --kube-api-qps="50" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816309 4498 flags.go:64] FLAG: --kube-reserved="" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816313 4498 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816317 4498 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816322 4498 flags.go:64] FLAG: --kubelet-cgroups="" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816326 4498 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816330 4498 flags.go:64] FLAG: --lock-file="" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816335 4498 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816339 4498 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816344 4498 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816352 4498 flags.go:64] FLAG: --log-json-split-stream="false" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816356 4498 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816361 4498 flags.go:64] FLAG: --log-text-split-stream="false" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816365 4498 flags.go:64] FLAG: --logging-format="text" Oct 30 12:57:04.823591 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816369 4498 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816375 4498 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816379 4498 flags.go:64] FLAG: --manifest-url="" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816383 4498 flags.go:64] FLAG: --manifest-url-header="" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816390 4498 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816395 4498 flags.go:64] FLAG: --max-open-files="1000000" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816401 4498 flags.go:64] FLAG: --max-pods="110" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816406 4498 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816410 4498 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816414 4498 flags.go:64] FLAG: --memory-manager-policy="None" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816419 4498 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816423 4498 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816427 4498 flags.go:64] FLAG: --node-ip="0.0.0.0" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816432 4498 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816441 4498 flags.go:64] FLAG: --node-status-max-images="50" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816446 4498 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816450 4498 flags.go:64] FLAG: --oom-score-adj="-999" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816455 4498 flags.go:64] FLAG: --pod-cidr="" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816459 4498 flags.go:64] FLAG: --pod-manifest-path="" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816463 4498 flags.go:64] FLAG: --pod-max-pids="-1" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816468 4498 flags.go:64] FLAG: --pods-per-core="0" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816472 4498 flags.go:64] FLAG: --port="10250" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816477 4498 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816481 4498 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03892f4b1ad99399c" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816486 4498 flags.go:64] FLAG: --qos-reserved="" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816490 4498 flags.go:64] FLAG: --read-only-port="10255" Oct 30 12:57:04.824134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816495 4498 flags.go:64] FLAG: --register-node="true" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816499 4498 flags.go:64] FLAG: --register-with-taints="" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816505 4498 flags.go:64] FLAG: --registry-burst="10" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816509 4498 flags.go:64] FLAG: --registry-qps="5" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816513 4498 flags.go:64] FLAG: --reserved-cpus="" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816517 4498 flags.go:64] FLAG: --reserved-memory="" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816523 4498 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816528 4498 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816532 4498 flags.go:64] FLAG: --rotate-certificates="false" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816536 4498 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816541 4498 flags.go:64] FLAG: --runonce="false" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816546 4498 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816551 4498 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816556 4498 flags.go:64] FLAG: --seccomp-default="false" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816560 4498 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816565 4498 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816569 4498 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816574 4498 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816578 4498 flags.go:64] FLAG: --storage-driver-password="root" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816583 4498 flags.go:64] FLAG: --storage-driver-secure="false" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816587 4498 flags.go:64] FLAG: --storage-driver-table="stats" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816591 4498 flags.go:64] FLAG: --storage-driver-user="root" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816596 4498 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816600 4498 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816605 4498 flags.go:64] FLAG: --system-cgroups="" Oct 30 12:57:04.824828 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816609 4498 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816617 4498 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816621 4498 flags.go:64] FLAG: --tls-cert-file="" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816626 4498 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816632 4498 flags.go:64] FLAG: --tls-min-version="" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816637 4498 flags.go:64] FLAG: --tls-private-key-file="" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816641 4498 flags.go:64] FLAG: --topology-manager-policy="none" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816645 4498 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816649 4498 flags.go:64] FLAG: --topology-manager-scope="container" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816654 4498 flags.go:64] FLAG: --v="2" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816660 4498 flags.go:64] FLAG: --version="false" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816666 4498 flags.go:64] FLAG: --vmodule="" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816672 4498 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.816677 4498 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816892 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816897 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816901 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816905 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816909 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816914 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816918 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816922 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.825480 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816926 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816931 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816935 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816939 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816943 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816947 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816953 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816959 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816965 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816970 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816975 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816979 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816984 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816988 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816992 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.816996 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817000 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817004 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817008 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.826129 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817012 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817016 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817020 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817026 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817030 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817034 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817038 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817042 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817046 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817050 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817055 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817060 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817064 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817068 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817072 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817076 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817080 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817083 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817087 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817093 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.826724 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817099 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817104 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817109 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817113 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817117 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817122 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817126 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817130 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817134 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817138 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817142 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817146 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817150 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817154 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817158 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817163 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817167 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817172 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817176 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817180 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.827242 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817184 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817189 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817208 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817213 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817217 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817222 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817226 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817229 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817233 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817237 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817241 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817246 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817250 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817254 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817258 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817262 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817266 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817270 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817274 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817278 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.827744 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817282 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817286 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817290 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817294 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817298 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817302 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817306 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817311 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817315 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817319 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817323 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817327 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817331 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817335 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817340 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817344 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817348 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817353 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.828243 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817356 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.817394 4498 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817447 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817453 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817458 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817464 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817469 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817474 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817478 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817482 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817486 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817491 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817495 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817499 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817503 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.828871 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817507 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817511 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817517 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817522 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817526 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817530 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817534 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817540 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817544 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817548 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817552 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817556 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817560 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817564 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817568 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817572 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817576 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817580 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817584 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.829500 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817589 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817593 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817597 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817603 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817607 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817611 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817615 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817619 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817623 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817626 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817630 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817634 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817639 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817643 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817647 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817652 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817658 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817663 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817667 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817671 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.830151 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817677 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817681 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817685 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817689 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817693 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817697 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817702 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817706 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817709 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817713 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817718 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817723 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817727 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817732 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817737 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817742 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817746 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817750 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817755 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817759 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.830773 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817763 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817767 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817771 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817774 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817778 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817782 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817787 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817790 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817794 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817798 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817802 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817806 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817811 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817816 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817819 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817823 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817827 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817831 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817835 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817839 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.831374 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817843 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817847 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817851 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817855 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817860 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817864 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817867 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817873 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817877 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817882 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817886 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817891 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817895 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.817899 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.823288 4498 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.823307 4498 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.823330 4498 watchdog_linux.go:95] "Systemd watchdog is not enabled" Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.823335 4498 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823393 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.831968 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823398 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823402 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823406 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823409 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823411 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823414 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823417 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823419 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823422 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823425 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823427 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823430 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823433 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823437 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823440 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823443 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823446 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823448 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823451 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.832556 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823454 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823456 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823459 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823462 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823464 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823467 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823470 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823473 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823476 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823479 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823481 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823484 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823486 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823489 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823491 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823494 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823496 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823499 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823501 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823504 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.833106 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823506 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823509 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823512 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823515 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823517 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823519 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823522 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823525 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823527 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823530 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823532 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823535 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823538 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823541 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823543 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823547 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823552 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823555 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823558 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.833599 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823560 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823563 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823565 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823568 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823570 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823573 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823575 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823578 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823581 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823583 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823585 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823588 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823591 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823594 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823597 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823599 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823602 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823605 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823607 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823610 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.834062 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823613 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823615 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823618 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823620 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823623 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823625 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823628 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823630 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823633 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823635 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823638 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823640 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823643 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823645 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823648 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823650 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823653 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823655 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823658 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823660 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.834576 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823662 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823665 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823667 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823669 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823672 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823675 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823677 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.823705 4498 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823850 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823854 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823857 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823860 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823862 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823865 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823869 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823871 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.835071 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823874 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823876 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823879 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823881 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823884 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823886 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823889 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823891 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823894 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823896 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823899 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823901 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823903 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823906 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823919 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823921 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823924 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823927 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823929 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823932 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.835474 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823934 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823937 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823939 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823941 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823944 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823947 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823949 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823952 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823954 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823957 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823960 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823963 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823965 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823968 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823970 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823972 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823975 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823977 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823980 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.835954 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823982 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823985 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823987 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823990 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823992 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823994 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823997 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.823999 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824002 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824004 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824007 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824009 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824012 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824014 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824017 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824019 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824021 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824024 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824026 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.836503 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824029 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824031 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824034 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824038 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824041 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824045 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824048 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824051 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824054 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824056 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824058 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824061 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824063 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824066 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824068 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824071 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824073 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824076 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824080 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824082 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.837069 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824085 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824087 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824090 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824092 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824094 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824097 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824099 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824102 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824104 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824106 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824109 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824111 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824114 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824116 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824119 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824121 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824124 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824126 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824129 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.837573 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824132 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.824158 4498 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824191 4498 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824207 4498 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824213 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824217 4498 feature_gate.go:386] unrecognized feature gate: OVNObservability Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824221 4498 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824226 4498 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824230 4498 feature_gate.go:386] unrecognized feature gate: OSStreams Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824234 4498 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824238 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824242 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824246 4498 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824248 4498 feature_gate.go:386] unrecognized feature gate: Example Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824251 4498 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824253 4498 feature_gate.go:386] unrecognized feature gate: InsightsConfig Oct 30 12:57:04.838048 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824256 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824258 4498 feature_gate.go:386] unrecognized feature gate: NewOLM Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824261 4498 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824263 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824269 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824272 4498 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824275 4498 feature_gate.go:386] unrecognized feature gate: KMSEncryption Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824277 4498 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824280 4498 feature_gate.go:386] unrecognized feature gate: DualReplica Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824283 4498 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824285 4498 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824288 4498 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824290 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824292 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824295 4498 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824297 4498 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824301 4498 feature_gate.go:386] unrecognized feature gate: SignatureStores Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824304 4498 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824307 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824309 4498 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Oct 30 12:57:04.838515 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824312 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824314 4498 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824316 4498 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824319 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824322 4498 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824324 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824327 4498 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824329 4498 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824333 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824336 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824339 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824342 4498 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824344 4498 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824346 4498 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824349 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824351 4498 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824356 4498 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824358 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824361 4498 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Oct 30 12:57:04.838992 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824364 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824366 4498 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824369 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824371 4498 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824374 4498 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824376 4498 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824379 4498 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824381 4498 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824384 4498 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824386 4498 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824399 4498 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824402 4498 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824405 4498 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824407 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824409 4498 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824413 4498 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824417 4498 feature_gate.go:386] unrecognized feature gate: TLSAdherence Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824420 4498 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824423 4498 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Oct 30 12:57:04.839498 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824425 4498 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824428 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824432 4498 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824435 4498 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824437 4498 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824440 4498 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824442 4498 feature_gate.go:386] unrecognized feature gate: Example2 Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824445 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824447 4498 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824449 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824454 4498 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824458 4498 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824462 4498 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824465 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824467 4498 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824470 4498 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824472 4498 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824475 4498 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824477 4498 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824480 4498 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Oct 30 12:57:04.839935 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824483 4498 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824485 4498 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824487 4498 feature_gate.go:386] unrecognized feature gate: EVPN Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824490 4498 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824493 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824496 4498 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824498 4498 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824501 4498 feature_gate.go:386] unrecognized feature gate: NetworkConnect Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824503 4498 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824505 4498 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824508 4498 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824510 4498 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824513 4498 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:04.824517 4498 feature_gate.go:386] unrecognized feature gate: EventTTL Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.824584 4498 server.go:957] "Client rotation is on, will bootstrap in background" Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.825590 4498 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.825643 4498 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.825821 4498 server.go:1014] "Starting client certificate rotation" Oct 30 12:57:04.840432 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.826022 4498 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.826093 4498 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 12:51:25 +0000 UTC" deadline="2028-08-06 21:40:34.068125606 +0000 UTC" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.826169 4498 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15512h43m29.241960306s" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.826367 4498 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.827537 4498 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.829511 4498 log.go:25] "Validated CRI v1 runtime API" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.831370 4498 log.go:25] "Validated CRI v1 image API" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.832226 4498 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 30 12:57:04.840906 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.834519 4498 fs.go:135] Filesystem UUIDs: map[073c8bee-a5a4-4dd9-990e-38b234b6fee6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d21eea88-56c6-4140-b4cc-3cc567b9fa5c:/dev/nvme0n1p3] Oct 30 12:57:04.841121 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.834544 4498 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/69d40b18a793bccb5d73bacfbadb3398c238279e1867783f7dde903efefb1f7a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/69d40b18a793bccb5d73bacfbadb3398c238279e1867783f7dde903efefb1f7a/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e2f926b-3781-439c-b532-ba54972d6b9f/volumes/kubernetes.io~projected/kube-api-access-98pm7:{mountpoint:/var/lib/kubelet/pods/0e2f926b-3781-439c-b532-ba54972d6b9f/volumes/kubernetes.io~projected/kube-api-access-98pm7 major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23/volumes/kubernetes.io~projected/kube-api-access-zcctp:{mountpoint:/var/lib/kubelet/pods/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23/volumes/kubernetes.io~projected/kube-api-access-zcctp major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4329ebd9-15fd-450a-8097-cc310c4cff77/volumes/kubernetes.io~projected/kube-api-access-8zgqp:{mountpoint:/var/lib/kubelet/pods/4329ebd9-15fd-450a-8097-cc310c4cff77/volumes/kubernetes.io~projected/kube-api-access-8zgqp major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62c000fd-3f35-44e1-8c56-dea1099fd496/volumes/kubernetes.io~projected/kube-api-access-rktst:{mountpoint:/var/lib/kubelet/pods/62c000fd-3f35-44e1-8c56-dea1099fd496/volumes/kubernetes.io~projected/kube-api-access-rktst major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6a613faa-490e-4961-b7c3-9e08092e06a5/volumes/kubernetes.io~projected/kube-api-access-z2xx8:{mountpoint:/var/lib/kubelet/pods/6a613faa-490e-4961-b7c3-9e08092e06a5/volumes/kubernetes.io~projected/kube-api-access-z2xx8 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/74918493-bf14-4a8f-a407-14cdbb526a92/volumes/kubernetes.io~projected/kube-api-access-dg2sl:{mountpoint:/var/lib/kubelet/pods/74918493-bf14-4a8f-a407-14cdbb526a92/volumes/kubernetes.io~projected/kube-api-access-dg2sl major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/774297e4-0a5c-458f-8d10-ecffd469fce1/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/774297e4-0a5c-458f-8d10-ecffd469fce1/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c591670-192b-401e-898d-0a914a94e4bf/volumes/kubernetes.io~projected/kube-api-access-j4jgl:{mountpoint:/var/lib/kubelet/pods/7c591670-192b-401e-898d-0a914a94e4bf/volumes/kubernetes.io~projected/kube-api-access-j4jgl major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7d0598da-23a6-4111-a3f1-f8e90c53674a/volumes/kubernetes.io~projected/kube-api-access-zcnbj:{mountpoint:/var/lib/kubelet/pods/7d0598da-23a6-4111-a3f1-f8e90c53674a/volumes/kubernetes.io~projected/kube-api-access-zcnbj major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a09d8584-bdfc-427f-83fe-5fd6e197c315/volumes/kubernetes.io~projected/kube-api-access-j9r6d:{mountpoint:/var/lib/kubelet/pods/a09d8584-bdfc-427f-83fe-5fd6e197c315/volumes/kubernetes.io~projected/kube-api-access-j9r6d major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a09d8584-bdfc-427f-83fe-5fd6e197c315/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/a09d8584-bdfc-427f-83fe-5fd6e197c315/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aa00b791-7a56-4038-83d2-e0f512626697/volumes/kubernetes.io~projected/kube-api-access-4q4ff:{mountpoint:/var/lib/kubelet/pods/aa00b791-7a56-4038-83d2-e0f512626697/volumes/kubernetes.io~projected/kube-api-access-4q4ff major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad20dd74-53df-4aff-9c3b-08e4e4d30177/volumes/kubernetes.io~projected/kube-api-access-svxhp:{mountpoint:/var/lib/kubelet/pods/ad20dd74-53df-4aff-9c3b-08e4e4d30177/volumes/kubernetes.io~projected/kube-api-access-svxhp major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volumes/kubernetes.io~projected/kube-api-access-vt6rg:{mountpoint:/var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volumes/kubernetes.io~projected/kube-api-access-vt6rg major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~empty-dir/tmp major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~projected/kube-api-access-wvwj9:{mountpoint:/var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~projected/kube-api-access-wvwj9 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/volumes/kubernetes.io~projected/kube-api-access-tmv9b:{mountpoint:/var/lib/kubelet/pods/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/volumes/kubernetes.io~projected/kube-api-access-tmv9b major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6a229d1-9609-403c-bde5-1e6238304859/volumes/kubernetes.io~projected/kube-api-access-5tfsm:{mountpoint:/var/lib/kubelet/pods/d6a229d1-9609-403c-bde5-1e6238304859/volumes/kubernetes.io~projected/kube-api-access-5tfsm major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/edecf660-2fb4-4fca-8663-c4bbbe986486/volumes/kubernetes.io~projected/kube-api-access-gcch7:{mountpoint:/var/lib/kubelet/pods/edecf660-2fb4-4fca-8663-c4bbbe986486/volumes/kubernetes.io~projected/kube-api-access-gcch7 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/edecf660-2fb4-4fca-8663-c4bbbe986486/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/edecf660-2fb4-4fca-8663-c4bbbe986486/volumes/kubernetes.io~secret/signing-key major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2bd8658-22fb-4aa8-a657-a363578881a8/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/f2bd8658-22fb-4aa8-a657-a363578881a8/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/0cf8bba974a1c6cbb29d915b08d9f75102572908ec556578ac008fd6df21f9de/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/04d146487671266550c718cdd865e32d8ec098c2addf65e80f7f6d1c7462eefd/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/460d19f06bfd6f9854c835d69b0ca9a04a0b57ade28b45bb898596140c054f37/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/5603471f977a7def5891d7655a8d091c6b229151cfe57401deecd4b51cffd159/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/7464667e91c25277db5ec98feb60c971987f7d12438257d43be605605af3dcc7/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/c6e9c410788c2161d001699cc7311cd1fc9758a4ae643f1e3350314208eaea33/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/bea5fd528b22a425a112bba7c0938ef7a8342f6c4082d6cd197ecf189babb926/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/94234df5a9130b8f85292853082b9f5a18b54d67f302fe5b54493a42ed3cc8db/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/a0b4c9bec87258feb75d6e5fdbef9bae437f40177fb39cb998eaa4af530d44b1/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/866e3787822921e3844f913342d8944809a1ae9f63f8d6b2d791ac677808d1b1/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/535e8cf55edd3f00b789fb8f5839e6b04fbe2b40eadd03ba50d0990e0aa98940/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/138339803ae74610d6337ebdecd6f9ae8d49cb0d6dd66f253f478232791dd1ec/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/a41206a216d0174f51385c213a5780a16750130d3e9dbbe9aa67c06ad4217a82/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/710aedce948ee7e6c3f872bdd4d773b1b97416419ba97b8e8580d093182535f2/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/5acd7f7b9e4cc8db2158398ded1bb3fcadfa64a6cea28287ccaacecb77bc97f4/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/01aa08d0d8bd829deaed2fe390b40ea3a115d4700d27c2e216a6c6f410e651f1/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/ba3ebbaf9781e3b214d9716f527b338b6b39000da9040fff22b14c242e3cd44c/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/3d3115f3ddfcd92b9195851a7a24db1133930d32d3a21ff98bc5642067a14568/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/652f41c99122d669d39951de78693309b48b8967a81cebaabcd65bbbe327859f/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/04deb71953736619b6aa09a9c503c6e2d6224b0c88cf54942a03f7b3dc242024/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/14a7d0f0daf3ec768310c5757858822994a3cf5684ffe85b9062b5b7481f463b/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/08c90540e67f5a7c2376cc01e2e826c93dc4cfc4fa72808b789078e7846e3767/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-206:{mountpoint:/var/lib/containers/storage/overlay/b39c6d53db7f9fcec8ce023105c4eb352eea8debdebc925ca38d390fd83117f7/merged major:0 minor:206 fsType:overlay blockSize:0} overlay_0-218:{mountpoint:/var/lib/containers/storage/overlay/178caa73b88d18a712a7db89401da22e6d508ca8363e3316c958ea1618ebe46b/merged major:0 minor:218 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/340991c0f5de9affec282aec7676e853375bc7d8fd9c52b5c169235e6ae43b40/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-230:{mountpoint:/var/lib/containers/storage/overlay/09f9f22a4ef0fb186869bb98bed84865c0f6cad3513d4cc1effb13b0a4f44af3/merged major:0 minor:230 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/eb79d6ff11a359cd4539a887dc4e6545d9a3c5735435fa8828c5e7b7dad8db92/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/a3be85715c9382e8bb6d81abdf48dcacd7ea888f83abd5bbb29b7c998b7b77d0/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/a26a556332d532dde8050415f5cbc40330e0853cc3a0f34f88ecf702d116c93a/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/d219f8fba73eb6e30e4a1266468dcb0c9a8b290a815adf65a260146e92686fcf/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/9b21f44f1b2dd6e08dcf446019d1fdda927b9359414d39615a050babad30c7b8/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/a06c021c7bd1903dd06cef34c01631ee3f4ae5812f3039a63024e49343466683/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/f2d2ea069d077e976368a02f0afbe4aa01d20b122a1f6c4913442e177edec385/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/ca32d5b65d30eeed38c6c46c47f710c6edd0a604925e98c8ff6f6d312257ba4c/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/8ca263550e3ccdf19bfdf147a4b6f29902109d1755348e8519de38b5fb2e7c8f/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/0ea706030769c2d5227434420019f243a9c442b5f8180fbe585364039e045772/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/c90dfe68198e33899f1289ca0aa055ce9dc23f8a5885e65abb35c557312d2fea/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/92225a4b7138df2585c0f6d57ef5e6666e7b9560ddb726b0ffebd219703c3493/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/761706c5ec103bd36890f4d5f87bd750bd2379302707687cd5298a554a258cbb/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/c5bea3cb1a18becb0105d1ac946f3d66292fa2cda2eb02ed86fcc23433d6cd1a/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/b9db9fceb3a7af633e13226e0efa8bd0cce2522a158d87e5107b3cd0185e71fc/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/954d4b30b7230844c77e788120eb90ece14ad849247f874874b009c135bb52d9/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/adb05901b260e8b90cd61edff9afa1000367fbc414e73770b4f870ffc28489b8/merged major:0 minor:96 fsType:overlay blockSize:0}] Oct 30 12:57:04.844560 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.844291 4498 manager.go:217] Machine: {Timestamp:2026-10-30 12:57:04.843420595 +0000 UTC m=+0.073703725 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105598 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26fcd79ffef4bc2284fc5921cc73e6 SystemUUID:ec26fcd7-9ffe-f4bc-2284-fc5921cc73e6 BootID:d9820882-a69a-4c0e-a874-7c9545777701 Filesystems:[{Device:/var/lib/kubelet/pods/edecf660-2fb4-4fca-8663-c4bbbe986486/volumes/kubernetes.io~projected/kube-api-access-gcch7 DeviceMajor:0 DeviceMinor:227 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e9a33b94e024e690d2f25fe51b7f402103f7d37e0a191618a336e2cceed45902/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7e2b8018877f5fda6d41d32026715abd3a6dec9247e80249d6c3ca31f0a3507d/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-206 DeviceMajor:0 DeviceMinor:206 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-218 DeviceMajor:0 DeviceMinor:218 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0e2f926b-3781-439c-b532-ba54972d6b9f/volumes/kubernetes.io~projected/kube-api-access-98pm7 DeviceMajor:0 DeviceMinor:64 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c59198a84d1fa764109cf1fe0d1409823618d9a7a97e1f739232c53ade8ade35/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a09d8584-bdfc-427f-83fe-5fd6e197c315/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23/volumes/kubernetes.io~projected/kube-api-access-zcctp DeviceMajor:0 DeviceMinor:62 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d06dd3d7cca2595c0f81000bc968237fb67f65365105897271dcc1089427102a/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7f8fa5c8fdd3bf532619deed736fcaf1245c02c68baac9bb1ca4bb3563293bc9/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volumes/kubernetes.io~projected/kube-api-access-vt6rg DeviceMajor:0 DeviceMinor:66 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/volumes/kubernetes.io~projected/kube-api-access-tmv9b DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/69d40b18a793bccb5d73bacfbadb3398c238279e1867783f7dde903efefb1f7a/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/74918493-bf14-4a8f-a407-14cdbb526a92/volumes/kubernetes.io~projected/kube-api-access-dg2sl DeviceMajor:0 DeviceMinor:65 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a039d47b73708310ec82b3787a60ad3ee10b85a8cd95cd943e8cc5d9310ce632/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a09d8584-bdfc-427f-83fe-5fd6e197c315/volumes/kubernetes.io~projected/kube-api-access-j9r6d DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b5d62fac-0db6-4150-b580-cc42eac91fb1/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/ad20dd74-53df-4aff-9c3b-08e4e4d30177/volumes/kubernetes.io~projected/kube-api-access-svxhp DeviceMajor:0 DeviceMinor:213 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/62c000fd-3f35-44e1-8c56-dea1099fd496/volumes/kubernetes.io~projected/kube-api-access-rktst DeviceMajor:0 DeviceMinor:223 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/449ef2e1ad6fa12b41c9ee3d2ffe737ad595801399a0a2e35abdc9df1c394aa4/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/774297e4-0a5c-458f-8d10-ecffd469fce1/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:208 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-230 DeviceMajor:0 DeviceMinor:230 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1c32e590a3425cbd733105a76abf0fec6c922ece5c47cd9c281d9d2a16f14100/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e2c50f7438b163be7672b872ffc5ac484b93dbe03d62f93f021a67976ed2a53b/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3ade8b69da52ab0ea19972293e94bf96b1a1f91e8a39f057f5ba0c6cec3bf461/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/f2bd8658-22fb-4aa8-a657-a363578881a8/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/6a613faa-490e-4961-b7c3-9e08092e06a5/volumes/kubernetes.io~projected/kube-api-access-z2xx8 DeviceMajor:0 DeviceMinor:60 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7d0598da-23a6-4111-a3f1-f8e90c53674a/volumes/kubernetes.io~projected/kube-api-access-zcnbj DeviceMajor:0 DeviceMinor:61 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d6a229d1-9609-403c-bde5-1e6238304859/volumes/kubernetes.io~projected/kube-api-access-5tfsm DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e0e4f0183376a58faf86b21d093ea60c09efbda374140d894ffb5fcfef6a8d1b/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/edecf660-2fb4-4fca-8663-c4bbbe986486/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:226 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/7c591670-192b-401e-898d-0a914a94e4bf/volumes/kubernetes.io~projected/kube-api-access-j4jgl DeviceMajor:0 DeviceMinor:232 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3eb273f9f968ba283474d9455e662cb55520b2a413fa5904eede4cca8ff981d7/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5e037efcea9b26d5e2a86f38ae149e82ea6fb10ffd3d34c1962694b70d5dbb1a/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/aa00b791-7a56-4038-83d2-e0f512626697/volumes/kubernetes.io~projected/kube-api-access-4q4ff DeviceMajor:0 DeviceMinor:63 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c1568d95-34ae-46fc-8bdf-7a8918cf3973/volumes/kubernetes.io~projected/kube-api-access-wvwj9 DeviceMajor:0 DeviceMinor:67 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4329ebd9-15fd-450a-8097-cc310c4cff77/volumes/kubernetes.io~projected/kube-api-access-8zgqp DeviceMajor:0 DeviceMinor:222 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:3ade8b69da52ab0 MacAddress:92:90:6a:8f:95:37 Speed:10000 Mtu:8901} {Name:3eb273f9f968ba2 MacAddress:3e:26:d1:67:29:66 Speed:10000 Mtu:8901} {Name:449ef2e1ad6fa12 MacAddress:fe:03:8f:41:fb:4f Speed:10000 Mtu:8901} {Name:5e037efcea9b26d MacAddress:ae:72:af:11:9d:a6 Speed:10000 Mtu:8901} {Name:69d40b18a793bcc MacAddress:b2:03:7e:27:9a:30 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:f6:36:37:83 Speed:0 Mtu:9001} {Name:br-int MacAddress:72:cf:e8:8c:93:3b Speed:0 Mtu:8901} {Name:e2c50f7438b163b MacAddress:56:59:58:d0:73:2f Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:f6:36:37:83 Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:2e:fd:63:ae:54:47 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:a2:fc:4d:eb:d4:1e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 30 12:57:04.844560 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.844564 4498 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 30 12:57:04.844820 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.844623 4498 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 30 12:57:04.844932 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.844908 4498 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 30 12:57:04.845061 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.844933 4498 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 30 12:57:04.845104 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845064 4498 topology_manager.go:143] "Creating topology manager with none policy" Oct 30 12:57:04.845104 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845071 4498 container_manager_linux.go:311] "Creating device plugin manager" Oct 30 12:57:04.845104 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845081 4498 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 12:57:04.845104 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845100 4498 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 30 12:57:04.845233 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845192 4498 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Oct 30 12:57:04.845411 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845401 4498 state_mem.go:41] "Initialized" logger="CPUManager state memory" Oct 30 12:57:04.845525 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845516 4498 server.go:1235] "Using root directory" path="/var/lib/kubelet" Oct 30 12:57:04.845560 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845552 4498 kubelet.go:493] "Attempting to sync node with API server" Oct 30 12:57:04.845589 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845562 4498 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 30 12:57:04.845589 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845572 4498 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 30 12:57:04.845589 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845581 4498 kubelet.go:405] "Adding apiserver pod source" Oct 30 12:57:04.845589 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.845589 4498 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 30 12:57:04.846322 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.846306 4498 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 12:57:04.846322 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.846319 4498 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 12:57:04.846833 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.846813 4498 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Oct 30 12:57:04.848809 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.848796 4498 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Oct 30 12:57:04.848809 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.848810 4498 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Oct 30 12:57:04.848916 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.848906 4498 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Oct 30 12:57:04.849101 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849090 4498 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Oct 30 12:57:04.849136 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849124 4498 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Oct 30 12:57:04.849262 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849251 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 30 12:57:04.849306 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849273 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 30 12:57:04.849306 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849288 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 30 12:57:04.849306 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849302 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849310 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849318 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849324 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849330 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849336 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849342 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849358 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 30 12:57:04.849381 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849370 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 30 12:57:04.849706 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849398 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 30 12:57:04.849706 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.849405 4498 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Oct 30 12:57:04.852754 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.852740 4498 server.go:1263] "Started kubelet" Oct 30 12:57:04.854456 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.852839 4498 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Oct 30 12:57:04.854456 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.852929 4498 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 30 12:57:04.854456 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.853152 4498 server_v1.go:49] "podresources" method="list" useActivePods=true Oct 30 12:57:04.854456 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.853474 4498 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 30 12:57:04.853320 ip-10-0-130-34 systemd[1]: Started Kubernetes Kubelet. Oct 30 12:57:04.854796 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.854498 4498 server.go:317] "Adding debug handlers to kubelet server" Oct 30 12:57:04.856559 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.856382 4498 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Oct 30 12:57:04.856559 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.856428 4498 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Oct 30 12:57:04.856559 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.856503 4498 volume_manager.go:309] "The desired_state_of_world populator starts" Oct 30 12:57:04.856559 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.856514 4498 volume_manager.go:311] "Starting Kubelet Volume Manager" Oct 30 12:57:04.858261 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:04.856531 4498 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-34.ec2.internal\" not found" Oct 30 12:57:04.858362 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.856473 4498 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 12:51:26 +0000 UTC" deadline="2028-07-18 18:29:49.660883282 +0000 UTC" Oct 30 12:57:04.858418 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.858368 4498 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15053h32m44.802523059s" Oct 30 12:57:04.860600 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860566 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23" volumeName="kubernetes.io/empty-dir/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-tmp-dir" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860602 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62c000fd-3f35-44e1-8c56-dea1099fd496" volumeName="kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860615 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a09d8584-bdfc-427f-83fe-5fd6e197c315" volumeName="kubernetes.io/projected/a09d8584-bdfc-427f-83fe-5fd6e197c315-kube-api-access-j9r6d" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860632 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad20dd74-53df-4aff-9c3b-08e4e4d30177" volumeName="kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860645 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5d62fac-0db6-4150-b580-cc42eac91fb1" volumeName="kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-config" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860661 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6a229d1-9609-403c-bde5-1e6238304859" volumeName="kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-multus-daemon-config" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860674 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23" volumeName="kubernetes.io/projected/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-kube-api-access-zcctp" seLinuxMountContext="" Oct 30 12:57:04.860698 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860685 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62c000fd-3f35-44e1-8c56-dea1099fd496" volumeName="kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860706 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62c000fd-3f35-44e1-8c56-dea1099fd496" volumeName="kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860718 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5d62fac-0db6-4150-b580-cc42eac91fb1" volumeName="kubernetes.io/secret/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovn-node-metrics-cert" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860767 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c591670-192b-401e-898d-0a914a94e4bf" volumeName="kubernetes.io/projected/7c591670-192b-401e-898d-0a914a94e4bf-kube-api-access-j4jgl" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860786 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2bd8658-22fb-4aa8-a657-a363578881a8" volumeName="kubernetes.io/configmap/f2bd8658-22fb-4aa8-a657-a363578881a8-konnectivity-ca" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860803 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2bd8658-22fb-4aa8-a657-a363578881a8" volumeName="kubernetes.io/secret/f2bd8658-22fb-4aa8-a657-a363578881a8-agent-certs" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860815 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e2f926b-3781-439c-b532-ba54972d6b9f" volumeName="kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-sysctl-allowlist" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860837 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e2f926b-3781-439c-b532-ba54972d6b9f" volumeName="kubernetes.io/projected/0e2f926b-3781-439c-b532-ba54972d6b9f-kube-api-access-98pm7" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860850 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa00b791-7a56-4038-83d2-e0f512626697" volumeName="kubernetes.io/configmap/aa00b791-7a56-4038-83d2-e0f512626697-iptables-alerter-script" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860868 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5d62fac-0db6-4150-b580-cc42eac91fb1" volumeName="kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-env-overrides" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860882 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1568d95-34ae-46fc-8bdf-7a8918cf3973" volumeName="kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-tuned" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860894 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c36c8a58-e432-4ad3-bb86-bbd4cdc345e5" volumeName="kubernetes.io/configmap/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-config-volume" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860911 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c36c8a58-e432-4ad3-bb86-bbd4cdc345e5" volumeName="kubernetes.io/empty-dir/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-tmp-dir" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860924 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4329ebd9-15fd-450a-8097-cc310c4cff77" volumeName="kubernetes.io/empty-dir/4329ebd9-15fd-450a-8097-cc310c4cff77-data-volume" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860940 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a613faa-490e-4961-b7c3-9e08092e06a5" volumeName="kubernetes.io/projected/6a613faa-490e-4961-b7c3-9e08092e06a5-kube-api-access-z2xx8" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860953 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="774297e4-0a5c-458f-8d10-ecffd469fce1" volumeName="kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860968 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1568d95-34ae-46fc-8bdf-7a8918cf3973" volumeName="kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-tmp" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860985 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c1568d95-34ae-46fc-8bdf-7a8918cf3973" volumeName="kubernetes.io/projected/c1568d95-34ae-46fc-8bdf-7a8918cf3973-kube-api-access-wvwj9" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.860997 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c36c8a58-e432-4ad3-bb86-bbd4cdc345e5" volumeName="kubernetes.io/projected/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-kube-api-access-tmv9b" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861015 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6a229d1-9609-403c-bde5-1e6238304859" volumeName="kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-cni-binary-copy" seLinuxMountContext="" Oct 30 12:57:04.861032 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861027 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edecf660-2fb4-4fca-8663-c4bbbe986486" volumeName="kubernetes.io/projected/edecf660-2fb4-4fca-8663-c4bbbe986486-kube-api-access-gcch7" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861053 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62c000fd-3f35-44e1-8c56-dea1099fd496" volumeName="kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861067 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7d0598da-23a6-4111-a3f1-f8e90c53674a" volumeName="kubernetes.io/projected/7d0598da-23a6-4111-a3f1-f8e90c53674a-kube-api-access-zcnbj" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861085 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a09d8584-bdfc-427f-83fe-5fd6e197c315" volumeName="kubernetes.io/secret/a09d8584-bdfc-427f-83fe-5fd6e197c315-cert" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861097 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aa00b791-7a56-4038-83d2-e0f512626697" volumeName="kubernetes.io/projected/aa00b791-7a56-4038-83d2-e0f512626697-kube-api-access-4q4ff" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861109 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6a229d1-9609-403c-bde5-1e6238304859" volumeName="kubernetes.io/projected/d6a229d1-9609-403c-bde5-1e6238304859-kube-api-access-5tfsm" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861132 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edecf660-2fb4-4fca-8663-c4bbbe986486" volumeName="kubernetes.io/configmap/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-cabundle" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861145 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4329ebd9-15fd-450a-8097-cc310c4cff77" volumeName="kubernetes.io/projected/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-api-access-8zgqp" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861163 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6a613faa-490e-4961-b7c3-9e08092e06a5" volumeName="kubernetes.io/configmap/6a613faa-490e-4961-b7c3-9e08092e06a5-serviceca" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861175 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="74918493-bf14-4a8f-a407-14cdbb526a92" volumeName="kubernetes.io/projected/74918493-bf14-4a8f-a407-14cdbb526a92-kube-api-access-dg2sl" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861186 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5d62fac-0db6-4150-b580-cc42eac91fb1" volumeName="kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-script-lib" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861220 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b5d62fac-0db6-4150-b580-cc42eac91fb1" volumeName="kubernetes.io/projected/b5d62fac-0db6-4150-b580-cc42eac91fb1-kube-api-access-vt6rg" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861234 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="edecf660-2fb4-4fca-8663-c4bbbe986486" volumeName="kubernetes.io/secret/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-key" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861252 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e2f926b-3781-439c-b532-ba54972d6b9f" volumeName="kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-whereabouts-flatfile-configmap" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861266 4498 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e2f926b-3781-439c-b532-ba54972d6b9f" volumeName="kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-binary-copy" seLinuxMountContext="" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861277 4498 reconstruct.go:97] "Volume reconstruction finished" Oct 30 12:57:04.861989 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.861285 4498 reconciler.go:29] "Reconciler: start to sync state" Oct 30 12:57:04.862751 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.862468 4498 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Oct 30 12:57:04.863459 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863270 4498 factory.go:55] Registering systemd factory Oct 30 12:57:04.863459 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863317 4498 factory.go:223] Registration of the systemd container factory successfully Oct 30 12:57:04.863790 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863768 4498 factory.go:153] Registering CRI-O factory Oct 30 12:57:04.863841 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863794 4498 factory.go:223] Registration of the crio container factory successfully Oct 30 12:57:04.863889 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863872 4498 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 30 12:57:04.863938 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863893 4498 factory.go:103] Registering Raw factory Oct 30 12:57:04.863938 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.863909 4498 manager.go:1199] Started watching for new ooms in manager Oct 30 12:57:04.864678 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.864656 4498 manager.go:319] Starting recovery of all containers Oct 30 12:57:04.875083 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.875063 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:57:04.875625 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.875606 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:57:04.891757 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.891723 4498 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Oct 30 12:57:04.893103 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.893079 4498 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Oct 30 12:57:04.893167 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.893112 4498 status_manager.go:249] "Starting to sync pod status with apiserver" Oct 30 12:57:04.893167 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.893136 4498 kubelet.go:2521] "Starting kubelet main sync loop" Oct 30 12:57:04.893304 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:04.893173 4498 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 30 12:57:04.902132 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.902093 4498 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Oct 30 12:57:04.902317 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.902291 4498 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:57:04.902400 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.902317 4498 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:57:04.903395 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.903369 4498 generic.go:356] "Generic (PLEG): container finished" podID="92414930f024c1b0c2c5fc6bf0ad88b7" containerID="cba40d65017f682953f759bf397b6be32966ca300634be3cd803ca8d4d2423ad" exitCode=0 Oct 30 12:57:04.913109 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.913083 4498 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:57:04.913515 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.913499 4498 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Oct 30 12:57:04.915981 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.915959 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 12:57:04.916389 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.916352 4498 generic.go:356] "Generic (PLEG): container finished" podID="b5d62fac-0db6-4150-b580-cc42eac91fb1" containerID="98bd1fcc25389dd856fb0e78f186b2200a75a3988e56e71c1b0866ac7b59a954" exitCode=1 Oct 30 12:57:04.924878 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.924849 4498 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="a09635b090525dd172688cd2b9e2c0923bbc398c6519ebbcd9557a64fe2a00a2" exitCode=0 Oct 30 12:57:04.924878 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.924874 4498 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="24a595f6436821e047f87b1bcb4e94dbe08a4815e94da6109af5a1918c57f2a0" exitCode=0 Oct 30 12:57:04.924878 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.924882 4498 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="438d7c100a59617d7781f0c2647d517db83ab1a62785101c270aea48760a2a8c" exitCode=0 Oct 30 12:57:04.925069 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.924919 4498 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="6d40ae9a4e25f1375ea4d3588d83235b17f0648b576f775c2ffbd5793431746c" exitCode=0 Oct 30 12:57:04.925069 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.924932 4498 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="7b5e5be90e18861a78454aa5e525914e2a914b4fde708c2f225fd7ac4467afa7" exitCode=0 Oct 30 12:57:04.925069 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.924943 4498 generic.go:356] "Generic (PLEG): container finished" podID="0e2f926b-3781-439c-b532-ba54972d6b9f" containerID="08abd9cb15a689237b7974d003d7a5cb8b8ecb4d2628be69801161e8e2d26f12" exitCode=0 Oct 30 12:57:04.940954 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.940930 4498 manager.go:324] Recovery completed Oct 30 12:57:04.955902 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.955879 4498 cpu_manager.go:226] "Starting" policy="none" Oct 30 12:57:04.955902 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.955896 4498 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Oct 30 12:57:04.956112 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.955916 4498 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Oct 30 12:57:04.956112 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956059 4498 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Oct 30 12:57:04.956112 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956073 4498 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Oct 30 12:57:04.956112 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956098 4498 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Oct 30 12:57:04.956112 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956106 4498 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Oct 30 12:57:04.956112 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956114 4498 policy_none.go:50] "Start" Oct 30 12:57:04.956418 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956126 4498 memory_manager.go:187] "Starting memorymanager" policy="None" Oct 30 12:57:04.956418 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956138 4498 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Oct 30 12:57:04.956418 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956342 4498 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Oct 30 12:57:04.956418 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956354 4498 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Oct 30 12:57:04.956418 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.956362 4498 policy_none.go:44] "Start" Oct 30 12:57:04.960487 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.960418 4498 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Oct 30 12:57:04.965090 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.965078 4498 manager.go:341] "Starting Device Plugin manager" Oct 30 12:57:04.965816 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:04.965101 4498 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Oct 30 12:57:04.965881 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.965819 4498 server.go:87] "Starting device plugin registration server" Oct 30 12:57:04.966077 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.966067 4498 eviction_manager.go:194] "Eviction manager: starting control loop" Oct 30 12:57:04.966133 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.966078 4498 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 30 12:57:04.966239 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.966225 4498 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 30 12:57:04.967716 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.966322 4498 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Oct 30 12:57:04.967785 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.967735 4498 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Oct 30 12:57:04.967785 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.967744 4498 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Oct 30 12:57:04.967884 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.967808 4498 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T12:57:04.96771543Z","UUID":"a9212228-fd9c-41c3-92c1-a6d7b75c4c5e","Handler":null,"Name":"","Endpoint":""} Oct 30 12:57:04.967934 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:04.967885 4498 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Oct 30 12:57:04.970131 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.970116 4498 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Oct 30 12:57:04.970253 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.970142 4498 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Oct 30 12:57:04.993287 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993245 4498 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal"] Oct 30 12:57:04.993841 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993802 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"92414930f024c1b0c2c5fc6bf0ad88b7","Type":"ContainerStarted","Data":"86d3aa5b801750f1f682c3687f6356ad0fbfa40832016770294e7a70e1ceb38d"} Oct 30 12:57:04.993841 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993853 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"92414930f024c1b0c2c5fc6bf0ad88b7","Type":"ContainerDied","Data":"cba40d65017f682953f759bf397b6be32966ca300634be3cd803ca8d4d2423ad"} Oct 30 12:57:04.993995 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993875 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" event={"ID":"92414930f024c1b0c2c5fc6bf0ad88b7","Type":"ContainerStarted","Data":"82824f7dbfc2e7c5eba3319fcfde924ee6f092962f3c0daf13f65c395217cc57"} Oct 30 12:57:04.993995 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993947 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" event={"ID":"ed215bcf2fbe8974076cda59d8c09a02","Type":"ContainerStarted","Data":"a475466cc857230a10acf1d16fb3a06c14c9ed24506a633638003ac50a3b403d"} Oct 30 12:57:04.993995 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993960 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" event={"ID":"ed215bcf2fbe8974076cda59d8c09a02","Type":"ContainerStarted","Data":"0e192b8ab8ea08312962dbc4177c788a5cd166b1b8c402d7c32b8fc2041aeaa3"} Oct 30 12:57:04.993995 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993990 4498 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:04.994177 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:04.993997 4498 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.015636 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.015613 4498 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 12:57:05.015723 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:05.015653 4498 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.016113 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.016099 4498 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 12:57:05.016152 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:05.016135 4498 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.066601 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.066569 4498 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Oct 30 12:57:05.069257 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.069241 4498 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientMemory" Oct 30 12:57:05.069324 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.069276 4498 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasNoDiskPressure" Oct 30 12:57:05.069324 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.069286 4498 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-34.ec2.internal" event="NodeHasSufficientPID" Oct 30 12:57:05.069324 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.069320 4498 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.101050 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.101030 4498 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.101151 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.101091 4498 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.102783 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.102755 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.102883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.102792 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.102883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.102812 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed215bcf2fbe8974076cda59d8c09a02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"ed215bcf2fbe8974076cda59d8c09a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.206104 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.206070 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.206321 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.206120 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.206321 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.206151 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed215bcf2fbe8974076cda59d8c09a02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"ed215bcf2fbe8974076cda59d8c09a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.206321 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.206183 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.206321 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.206250 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92414930f024c1b0c2c5fc6bf0ad88b7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" (UID: \"92414930f024c1b0c2c5fc6bf0ad88b7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.206321 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.206260 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ed215bcf2fbe8974076cda59d8c09a02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" (UID: \"ed215bcf2fbe8974076cda59d8c09a02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.846143 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.846109 4498 apiserver.go:52] "Watching apiserver" Oct 30 12:57:05.914662 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.914623 4498 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Oct 30 12:57:05.915132 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.915110 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-zp996","openshift-insights/insights-runtime-extractor-95x2c","kube-system/global-pull-secret-syncer-gwd9f","openshift-dns/dns-default-lxnch","openshift-ingress-canary/ingress-canary-p4cbf","openshift-service-ca/service-ca-5fffc97bdf-4hnkf","openshift-multus/network-metrics-daemon-wxdwb","kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal","kube-system/konnectivity-agent-fnn4j","openshift-cluster-node-tuning-operator/tuned-s7trc","openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal","openshift-multus/multus-additional-cni-plugins-kcqr7","openshift-network-diagnostics/network-check-target-ng2cv","openshift-insights/periodic-gathering-2j9r4-hrv7r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86","openshift-multus/multus-nkmrf","openshift-dns/node-resolver-fghs2","openshift-network-operator/iptables-alerter-s4z5v","openshift-ovn-kubernetes/ovnkube-node-v9n64"] Oct 30 12:57:05.919403 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.919373 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:05.923115 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.923097 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:05.923508 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.923493 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:05.928741 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.928688 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Oct 30 12:57:05.928850 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.928780 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Oct 30 12:57:05.929713 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.929660 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94phb\"" Oct 30 12:57:05.929778 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.929726 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Oct 30 12:57:05.930078 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.930063 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-25fk6\"" Oct 30 12:57:05.930187 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.930079 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Oct 30 12:57:05.930187 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.930084 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-sqtw6\"" Oct 30 12:57:05.930490 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.930476 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.930887 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.930873 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.931007 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.930981 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.931082 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.931069 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.932356 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.932341 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tzbll\"" Oct 30 12:57:05.932991 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.932976 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.933231 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.933217 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Oct 30 12:57:05.933296 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.933234 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Oct 30 12:57:05.933296 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.933279 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.933296 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.933288 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v4tv9\"" Oct 30 12:57:05.933296 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.933273 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.934543 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.934523 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-sp79l\"" Oct 30 12:57:05.934642 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.934632 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7gdbz\"" Oct 30 12:57:05.934985 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.934973 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Oct 30 12:57:05.935323 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.935312 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cxt4s\"" Oct 30 12:57:05.935423 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.935411 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Oct 30 12:57:05.937297 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.937281 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.937397 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.937324 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Oct 30 12:57:05.937397 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.937352 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.938076 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.938061 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.938427 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.938412 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.939174 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.939160 4498 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.939373 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.939361 4498 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.940525 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.940509 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bbfv\"" Oct 30 12:57:05.940697 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.940679 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-vg7bt\"" Oct 30 12:57:05.940767 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.940742 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dz42j\"" Oct 30 12:57:05.940767 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.940759 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kmvh7\"" Oct 30 12:57:05.941007 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.940980 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.941399 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941384 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.941512 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941495 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.941512 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941507 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.941634 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941516 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Oct 30 12:57:05.941634 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941495 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.941634 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941558 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Oct 30 12:57:05.941634 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941565 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Oct 30 12:57:05.941811 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941799 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Oct 30 12:57:05.941863 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941850 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Oct 30 12:57:05.941973 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.941962 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Oct 30 12:57:05.942303 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.942288 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Oct 30 12:57:05.942354 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.942342 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Oct 30 12:57:05.942410 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.942385 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Oct 30 12:57:05.942410 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.942396 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Oct 30 12:57:05.942497 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.942434 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xt92t\"" Oct 30 12:57:05.946113 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.946094 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.946113 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.946101 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Oct 30 12:57:05.946256 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.946133 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.946552 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.946531 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Oct 30 12:57:05.949244 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.949226 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.949327 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.949260 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Oct 30 12:57:05.949327 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.949291 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.949327 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.949304 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fslsc\"" Oct 30 12:57:05.949470 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.949406 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rlrpr\"" Oct 30 12:57:05.949971 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.949952 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wf8rx\"" Oct 30 12:57:05.950035 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.950021 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-wsrzk\"" Oct 30 12:57:05.951558 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951532 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-sdfnl\"" Oct 30 12:57:05.951664 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951560 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Oct 30 12:57:05.951664 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951575 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.951664 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951611 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Oct 30 12:57:05.951664 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951630 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Oct 30 12:57:05.951664 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951655 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.951973 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.951827 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Oct 30 12:57:05.962183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.962167 4498 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 12:57:05.962272 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:05.962218 4498 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-34.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.962874 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.962862 4498 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Oct 30 12:57:05.962912 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:05.962893 4498 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-34.ec2.internal" Oct 30 12:57:05.963881 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:05.963868 4498 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Oct 30 12:57:06.010168 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010147 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcctp\" (UniqueName: \"kubernetes.io/projected/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-kube-api-access-zcctp\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.010295 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010174 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-socket-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.010295 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010191 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-conf\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.010295 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010223 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-cnibin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.010295 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010243 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-bin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.010472 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010326 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-conf-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.010472 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010361 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4329ebd9-15fd-450a-8097-cc310c4cff77-data-volume\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.010472 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010379 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-key\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:06.010472 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010402 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.010472 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010425 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovn-node-metrics-cert\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.010472 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010468 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4329ebd9-15fd-450a-8097-cc310c4cff77-data-volume\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010448 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysconfig\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010505 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-cni-binary-copy\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010583 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-bin\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010631 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-tmp-dir\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010670 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jgl\" (UniqueName: \"kubernetes.io/projected/7c591670-192b-401e-898d-0a914a94e4bf-kube-api-access-j4jgl\") pod \"migrator-66df5d496b-72zx7\" (UID: \"7c591670-192b-401e-898d-0a914a94e4bf\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010681 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010693 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-key\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010703 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-cni-binary-copy\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010742 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.010763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010762 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-tmp-dir\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010782 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tfsm\" (UniqueName: \"kubernetes.io/projected/d6a229d1-9609-403c-bde5-1e6238304859-kube-api-access-5tfsm\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010810 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010841 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010870 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010902 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovn-node-metrics-cert\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.010983 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98pm7\" (UniqueName: \"kubernetes.io/projected/0e2f926b-3781-439c-b532-ba54972d6b9f-kube-api-access-98pm7\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011014 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-sys\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011099 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-host\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011156 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-system-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011179 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011185 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-multus\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.011268 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011243 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011285 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-run\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011394 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvwj9\" (UniqueName: \"kubernetes.io/projected/c1568d95-34ae-46fc-8bdf-7a8918cf3973-kube-api-access-wvwj9\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011433 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-netns\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011465 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-hostroot\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011480 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/774297e4-0a5c-458f-8d10-ecffd469fce1-original-pull-secret\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011500 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmv9b\" (UniqueName: \"kubernetes.io/projected/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-kube-api-access-tmv9b\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011528 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4329ebd9-15fd-450a-8097-cc310c4cff77-crio-socket\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011553 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011579 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011607 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-kubernetes\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011624 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011639 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-systemd-units\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011656 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-slash\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011682 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-systemd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011704 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-ovn\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011717 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-node-log\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.011737 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011733 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-netd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011747 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-cnibin\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011763 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-tuned\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011796 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-multus-daemon-config\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011813 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011828 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-cabundle\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011846 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011921 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-tuned\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011945 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-etc-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011972 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011995 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6a229d1-9609-403c-bde5-1e6238304859-multus-daemon-config\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.011998 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012008 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/edecf660-2fb4-4fca-8663-c4bbbe986486-signing-cabundle\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012078 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-kubelet\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012108 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-lib-modules\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012143 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012181 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-dbus\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012236 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-registration-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012264 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012312 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-sys-fs\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012339 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa00b791-7a56-4038-83d2-e0f512626697-host-slash\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012348 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012379 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012400 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2xx8\" (UniqueName: \"kubernetes.io/projected/6a613faa-490e-4961-b7c3-9e08092e06a5-kube-api-access-z2xx8\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012415 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-tmp\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.012420 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012431 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-socket-dir-parent\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012446 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-config-volume\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012462 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012518 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-kubelet\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012564 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012591 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1568d95-34ae-46fc-8bdf-7a8918cf3973-tmp\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012591 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e2f926b-3781-439c-b532-ba54972d6b9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012613 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-kubelet-config\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012659 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-modprobe-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012680 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-config\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012696 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-hosts-file\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012730 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-device-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012732 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-config-volume\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012753 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnbj\" (UniqueName: \"kubernetes.io/projected/7d0598da-23a6-4111-a3f1-f8e90c53674a-kube-api-access-zcnbj\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012808 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012884 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012881 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-config\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.012973 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09d8584-bdfc-427f-83fe-5fd6e197c315-cert\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013001 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-k8s-cni-cncf-io\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013024 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-multus-certs\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013046 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-netns\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013063 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-script-lib\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013078 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013097 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2bd8658-22fb-4aa8-a657-a363578881a8-agent-certs\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013154 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a09d8584-bdfc-427f-83fe-5fd6e197c315-cert\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013227 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa00b791-7a56-4038-83d2-e0f512626697-iptables-alerter-script\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013257 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-tmp-dir\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013288 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zgqp\" (UniqueName: \"kubernetes.io/projected/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-api-access-8zgqp\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013303 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-ovnkube-script-lib\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013313 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-log-socket\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013335 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a613faa-490e-4961-b7c3-9e08092e06a5-host\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013346 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2bd8658-22fb-4aa8-a657-a363578881a8-agent-certs\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013350 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-tmp-dir\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013359 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2sl\" (UniqueName: \"kubernetes.io/projected/74918493-bf14-4a8f-a407-14cdbb526a92-kube-api-access-dg2sl\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013388 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/aa00b791-7a56-4038-83d2-e0f512626697-iptables-alerter-script\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.013385 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013395 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-etc-kubernetes\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013491 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-env-overrides\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013515 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6rg\" (UniqueName: \"kubernetes.io/projected/b5d62fac-0db6-4150-b580-cc42eac91fb1-kube-api-access-vt6rg\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013531 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-systemd\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013558 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-var-lib-kubelet\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013646 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5d62fac-0db6-4150-b580-cc42eac91fb1-env-overrides\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013674 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q4ff\" (UniqueName: \"kubernetes.io/projected/aa00b791-7a56-4038-83d2-e0f512626697-kube-api-access-4q4ff\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013697 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013713 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a613faa-490e-4961-b7c3-9e08092e06a5-serviceca\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013733 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2bd8658-22fb-4aa8-a657-a363578881a8-konnectivity-ca\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013755 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9r6d\" (UniqueName: \"kubernetes.io/projected/a09d8584-bdfc-427f-83fe-5fd6e197c315-kube-api-access-j9r6d\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013772 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013787 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013807 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcch7\" (UniqueName: \"kubernetes.io/projected/edecf660-2fb4-4fca-8663-c4bbbe986486-kube-api-access-gcch7\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013833 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-var-lib-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013877 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6a613faa-490e-4961-b7c3-9e08092e06a5-serviceca\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.014535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.013902 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2bd8658-22fb-4aa8-a657-a363578881a8-konnectivity-ca\") pod \"konnectivity-agent-fnn4j\" (UID: \"f2bd8658-22fb-4aa8-a657-a363578881a8\") " pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:57:06.041997 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.041976 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcctp\" (UniqueName: \"kubernetes.io/projected/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-kube-api-access-zcctp\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.042230 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.042215 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tfsm\" (UniqueName: \"kubernetes.io/projected/d6a229d1-9609-403c-bde5-1e6238304859-kube-api-access-5tfsm\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.042957 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.042932 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6rg\" (UniqueName: \"kubernetes.io/projected/b5d62fac-0db6-4150-b580-cc42eac91fb1-kube-api-access-vt6rg\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.043039 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.043024 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zgqp\" (UniqueName: \"kubernetes.io/projected/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-api-access-8zgqp\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.046839 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.046820 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svxhp\" (UniqueName: \"kubernetes.io/projected/ad20dd74-53df-4aff-9c3b-08e4e4d30177-kube-api-access-svxhp\") pod \"network-check-target-ng2cv\" (UID: \"ad20dd74-53df-4aff-9c3b-08e4e4d30177\") " pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:57:06.046980 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.046961 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnbj\" (UniqueName: \"kubernetes.io/projected/7d0598da-23a6-4111-a3f1-f8e90c53674a-kube-api-access-zcnbj\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.048473 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.048422 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2xx8\" (UniqueName: \"kubernetes.io/projected/6a613faa-490e-4961-b7c3-9e08092e06a5-kube-api-access-z2xx8\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.048620 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.048592 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q4ff\" (UniqueName: \"kubernetes.io/projected/aa00b791-7a56-4038-83d2-e0f512626697-kube-api-access-4q4ff\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.050878 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.050857 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2sl\" (UniqueName: \"kubernetes.io/projected/74918493-bf14-4a8f-a407-14cdbb526a92-kube-api-access-dg2sl\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:06.051558 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.051539 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9r6d\" (UniqueName: \"kubernetes.io/projected/a09d8584-bdfc-427f-83fe-5fd6e197c315-kube-api-access-j9r6d\") pod \"ingress-canary-p4cbf\" (UID: \"a09d8584-bdfc-427f-83fe-5fd6e197c315\") " pod="openshift-ingress-canary/ingress-canary-p4cbf" Oct 30 12:57:06.052726 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.052704 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jgl\" (UniqueName: \"kubernetes.io/projected/7c591670-192b-401e-898d-0a914a94e4bf-kube-api-access-j4jgl\") pod \"migrator-66df5d496b-72zx7\" (UID: \"7c591670-192b-401e-898d-0a914a94e4bf\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-72zx7" Oct 30 12:57:06.052903 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.052882 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") pod \"periodic-gathering-2j9r4-hrv7r\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:06.052979 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.052898 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98pm7\" (UniqueName: \"kubernetes.io/projected/0e2f926b-3781-439c-b532-ba54972d6b9f-kube-api-access-98pm7\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.054447 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.054425 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmv9b\" (UniqueName: \"kubernetes.io/projected/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-kube-api-access-tmv9b\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.054606 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.054587 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvwj9\" (UniqueName: \"kubernetes.io/projected/c1568d95-34ae-46fc-8bdf-7a8918cf3973-kube-api-access-wvwj9\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.054682 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.054638 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcch7\" (UniqueName: \"kubernetes.io/projected/edecf660-2fb4-4fca-8663-c4bbbe986486-kube-api-access-gcch7\") pod \"service-ca-5fffc97bdf-4hnkf\" (UID: \"edecf660-2fb4-4fca-8663-c4bbbe986486\") " pod="openshift-service-ca/service-ca-5fffc97bdf-4hnkf" Oct 30 12:57:06.114915 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114860 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.114915 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114887 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114918 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-var-lib-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114942 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-socket-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114966 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-conf\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114983 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114984 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-var-lib-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.114990 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-cnibin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115040 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-bin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115063 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-socket-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115075 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-conf-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115101 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysconfig\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115108 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-bin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115118 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-conf\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115127 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-bin\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115136 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-conf-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115152 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-bin\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.115129 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115152 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysconfig\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115154 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115209 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115235 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-sys\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115100 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-cnibin\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115253 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-host\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115280 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115291 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-host\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115290 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-sysctl-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115308 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-system-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115343 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-multus\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115381 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-run\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115306 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-sys\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115375 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-system-cni-dir\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115429 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-cni-multus\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115439 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-run\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115409 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-netns\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115443 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-netns\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115479 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4329ebd9-15fd-450a-8097-cc310c4cff77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115505 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-hostroot\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115544 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4329ebd9-15fd-450a-8097-cc310c4cff77-crio-socket\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115545 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-hostroot\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115566 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115586 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-kubernetes\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115602 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-systemd-units\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115610 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4329ebd9-15fd-450a-8097-cc310c4cff77-crio-socket\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115622 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-slash\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115663 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-systemd-units\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115673 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-kubernetes\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115698 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-systemd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115677 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-slash\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.115710 4498 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115731 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-ovn\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115764 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-systemd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.115781 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:06.615764405 +0000 UTC m=+1.846047539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115766 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-node-log\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115792 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-ovn\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115799 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-node-log\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115813 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-netd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115836 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-cnibin\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115848 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-cni-netd\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115876 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-cnibin\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115855 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115911 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-etc-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.115931 4498 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115938 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-etc-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115943 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115975 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.115978 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.115999 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:06.615984665 +0000 UTC m=+1.846267778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116013 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116032 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-kubelet\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116064 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-lib-modules\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116078 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-dbus\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.116055 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116095 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-registration-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116112 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116096 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-var-lib-kubelet\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116133 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-sys-fs\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116144 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-registration-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116151 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa00b791-7a56-4038-83d2-e0f512626697-host-slash\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116153 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-dbus\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116165 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-lib-modules\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116170 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116174 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-socket-dir-parent\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116191 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-sys-fs\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116219 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-kubelet\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116225 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa00b791-7a56-4038-83d2-e0f512626697-host-slash\") pod \"iptables-alerter-s4z5v\" (UID: \"aa00b791-7a56-4038-83d2-e0f512626697\") " pod="openshift-network-operator/iptables-alerter-s4z5v" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116234 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-multus-socket-dir-parent\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116243 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116266 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-kubelet\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116266 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-kubelet-config\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116288 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-run-openvswitch\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116294 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-modprobe-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116311 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/774297e4-0a5c-458f-8d10-ecffd469fce1-kubelet-config\") pod \"global-pull-secret-syncer-gwd9f\" (UID: \"774297e4-0a5c-458f-8d10-ecffd469fce1\") " pod="kube-system/global-pull-secret-syncer-gwd9f" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116325 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-hosts-file\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116349 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-device-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116356 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-modprobe-d\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116362 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23-hosts-file\") pod \"node-resolver-fghs2\" (UID: \"2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23\") " pod="openshift-dns/node-resolver-fghs2" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116373 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116398 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-k8s-cni-cncf-io\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116424 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-multus-certs\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116454 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-netns\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116455 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-k8s-cni-cncf-io\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116401 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7d0598da-23a6-4111-a3f1-f8e90c53674a-device-dir\") pod \"aws-ebs-csi-driver-node-r4c86\" (UID: \"7d0598da-23a6-4111-a3f1-f8e90c53674a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r4c86" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116481 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116487 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-host-run-multus-certs\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.116507 4498 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116520 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-system-cni-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116509 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-log-socket\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116505 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-host-run-netns\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116546 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5d62fac-0db6-4150-b580-cc42eac91fb1-log-socket\") pod \"ovnkube-node-v9n64\" (UID: \"b5d62fac-0db6-4150-b580-cc42eac91fb1\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116545 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a613faa-490e-4961-b7c3-9e08092e06a5-host\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.116562 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:06.616546346 +0000 UTC m=+1.846829459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : secret "metrics-daemon-secret" not found Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116575 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a613faa-490e-4961-b7c3-9e08092e06a5-host\") pod \"node-ca-zp996\" (UID: \"6a613faa-490e-4961-b7c3-9e08092e06a5\") " pod="openshift-image-registry/node-ca-zp996" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116594 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-etc-kubernetes\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116616 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-systemd\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116637 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-var-lib-kubelet\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116676 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a229d1-9609-403c-bde5-1e6238304859-etc-kubernetes\") pod \"multus-nkmrf\" (UID: \"d6a229d1-9609-403c-bde5-1e6238304859\") " pod="openshift-multus/multus-nkmrf" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116684 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-etc-systemd\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116688 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1568d95-34ae-46fc-8bdf-7a8918cf3973-var-lib-kubelet\") pod \"tuned-s7trc\" (UID: \"c1568d95-34ae-46fc-8bdf-7a8918cf3973\") " pod="openshift-cluster-node-tuning-operator/tuned-s7trc" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116707 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.117764 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.116770 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e2f926b-3781-439c-b532-ba54972d6b9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kcqr7\" (UID: \"0e2f926b-3781-439c-b532-ba54972d6b9f\") " pod="openshift-multus/multus-additional-cni-plugins-kcqr7" Oct 30 12:57:06.619584 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.619543 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:06.619757 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.619621 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:06.619757 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:06.619646 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:06.619757 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.619660 4498 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 12:57:06.619757 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.619742 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:07.619727317 +0000 UTC m=+2.850010429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : secret "metrics-daemon-secret" not found Oct 30 12:57:06.619757 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.619742 4498 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:57:06.619940 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.619805 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:07.619794462 +0000 UTC m=+2.850077574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:57:06.619940 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.619742 4498 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:06.619940 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:06.619836 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:07.61982981 +0000 UTC m=+2.850112922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:07.626824 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:07.626783 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:07.626833 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:07.626869 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:07.626929 4498 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:07.626989 4498 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:07.626996 4498 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:07.626996 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:09.626980366 +0000 UTC m=+4.857263478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:07.627066 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:09.62705142 +0000 UTC m=+4.857334534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:57:07.627292 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:07.627083 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:09.627072005 +0000 UTC m=+4.857355118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : secret "metrics-daemon-secret" not found Oct 30 12:57:08.680015 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:08.679981 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:57:09.640871 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:09.640817 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:09.641061 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:09.640911 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:09.641061 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:09.640945 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:09.641061 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:09.640976 4498 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Oct 30 12:57:09.641061 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:09.641044 4498 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Oct 30 12:57:09.641061 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:09.641043 4498 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:09.641317 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:09.641049 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs podName:74918493-bf14-4a8f-a407-14cdbb526a92 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:13.641034703 +0000 UTC m=+8.871317829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs") pod "network-metrics-daemon-wxdwb" (UID: "74918493-bf14-4a8f-a407-14cdbb526a92") : secret "metrics-daemon-secret" not found Oct 30 12:57:09.641317 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:09.641130 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls podName:c36c8a58-e432-4ad3-bb86-bbd4cdc345e5 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:13.641117171 +0000 UTC m=+8.871400285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls") pod "dns-default-lxnch" (UID: "c36c8a58-e432-4ad3-bb86-bbd4cdc345e5") : secret "dns-default-metrics-tls" not found Oct 30 12:57:09.641317 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:09.641140 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:13.641134252 +0000 UTC m=+8.871417364 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:09.806805 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:09.806782 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fghs2_2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23/dns-node-resolver/0.log" Oct 30 12:57:11.006498 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:11.006474 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zp996_6a613faa-490e-4961-b7c3-9e08092e06a5/node-ca/0.log" Oct 30 12:57:11.606655 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:11.606607 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p4cbf_a09d8584-bdfc-427f-83fe-5fd6e197c315/serve-healthcheck-canary/0.log" Oct 30 12:57:11.806947 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:11.806908 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-72zx7_7c591670-192b-401e-898d-0a914a94e4bf/migrator/0.log" Oct 30 12:57:13.671974 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.671940 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:13.672496 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.671996 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:13.672496 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.672017 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:13.672496 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:13.672171 4498 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Oct 30 12:57:13.672496 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:13.672288 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls podName:4329ebd9-15fd-450a-8097-cc310c4cff77 nodeName:}" failed. No retries permitted until 2026-10-30 12:57:21.67226648 +0000 UTC m=+16.902549610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-95x2c" (UID: "4329ebd9-15fd-450a-8097-cc310c4cff77") : secret "insights-runtime-extractor-tls" not found Oct 30 12:57:13.672496 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.672397 4498 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 30 12:57:13.674640 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.674614 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74918493-bf14-4a8f-a407-14cdbb526a92-metrics-certs\") pod \"network-metrics-daemon-wxdwb\" (UID: \"74918493-bf14-4a8f-a407-14cdbb526a92\") " pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:13.674640 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.674629 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36c8a58-e432-4ad3-bb86-bbd4cdc345e5-metrics-tls\") pod \"dns-default-lxnch\" (UID: \"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5\") " pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:13.720372 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.720337 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxdwb" Oct 30 12:57:13.724189 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.724169 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:13.895101 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:13.895072 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:14.037462 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.037431 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wxdwb"] Oct 30 12:57:14.041258 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.041230 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lxnch"] Oct 30 12:57:14.041348 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:14.041247 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74918493_bf14_4a8f_a407_14cdbb526a92.slice/crio-eeed584e14009321ef7563597beb3270d9c9bad79dd7d99105bbb586a86cfcae WatchSource:0}: Error finding container eeed584e14009321ef7563597beb3270d9c9bad79dd7d99105bbb586a86cfcae: Status 404 returned error can't find the container with id eeed584e14009321ef7563597beb3270d9c9bad79dd7d99105bbb586a86cfcae Oct 30 12:57:14.043662 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.043644 4498 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 12:57:14.043984 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:14.043963 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36c8a58_e432_4ad3_bb86_bbd4cdc345e5.slice/crio-bc3a9fbc81ff91140ae21138ca34e8b431005e121647df50936702b28cc6616f WatchSource:0}: Error finding container bc3a9fbc81ff91140ae21138ca34e8b431005e121647df50936702b28cc6616f: Status 404 returned error can't find the container with id bc3a9fbc81ff91140ae21138ca34e8b431005e121647df50936702b28cc6616f Oct 30 12:57:14.844235 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.844174 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:14.844677 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.844413 4498 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 12:57:14.962774 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.962737 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wxdwb" event={"ID":"74918493-bf14-4a8f-a407-14cdbb526a92","Type":"ContainerStarted","Data":"eeed584e14009321ef7563597beb3270d9c9bad79dd7d99105bbb586a86cfcae"} Oct 30 12:57:14.964422 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:14.964387 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxnch" event={"ID":"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5","Type":"ContainerStarted","Data":"bc3a9fbc81ff91140ae21138ca34e8b431005e121647df50936702b28cc6616f"} Oct 30 12:57:15.970150 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:15.970096 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wxdwb" event={"ID":"74918493-bf14-4a8f-a407-14cdbb526a92","Type":"ContainerStarted","Data":"dad7748073846b6088b4957b8b73f586158e5c99f58b455482f527d4c2006fa9"} Oct 30 12:57:15.970608 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:15.970233 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wxdwb" event={"ID":"74918493-bf14-4a8f-a407-14cdbb526a92","Type":"ContainerStarted","Data":"91fcb53f931cc802b2b4ec3cc5da8612050d7f532f11d4567b31522d748970ca"} Oct 30 12:57:15.971916 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:15.971887 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxnch" event={"ID":"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5","Type":"ContainerStarted","Data":"65eb6ffbe1b67b33cc386af54e3dd3ab1b756ca8d04b9c45f15c806b4d96ecf6"} Oct 30 12:57:15.972012 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:15.971925 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lxnch" event={"ID":"c36c8a58-e432-4ad3-bb86-bbd4cdc345e5","Type":"ContainerStarted","Data":"4f66fa571348de2bb452b17d434a71a8a6ea7ef7ee8d01a57314b769491fd36f"} Oct 30 12:57:15.972012 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:15.971962 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:17.524734 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:17.524710 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9n64" Oct 30 12:57:20.799439 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:20.799405 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnn4j" Oct 30 12:57:21.728523 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:21.728489 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:21.730862 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:21.730839 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4329ebd9-15fd-450a-8097-cc310c4cff77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-95x2c\" (UID: \"4329ebd9-15fd-450a-8097-cc310c4cff77\") " pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:21.824053 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:21.824011 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-95x2c" Oct 30 12:57:22.116477 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:22.116344 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-95x2c"] Oct 30 12:57:22.119606 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:22.119578 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4329ebd9_15fd_450a_8097_cc310c4cff77.slice/crio-eaa93a333cf9704fb8a8923a7e210818b6df960aca193e44dc48106ef9a2509d WatchSource:0}: Error finding container eaa93a333cf9704fb8a8923a7e210818b6df960aca193e44dc48106ef9a2509d: Status 404 returned error can't find the container with id eaa93a333cf9704fb8a8923a7e210818b6df960aca193e44dc48106ef9a2509d Oct 30 12:57:22.998187 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:22.998152 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95x2c" event={"ID":"4329ebd9-15fd-450a-8097-cc310c4cff77","Type":"ContainerStarted","Data":"192593d0c233e000991c180cde7e7b8531a4b8cc6026f8cd8c3c4c22d33256be"} Oct 30 12:57:22.998590 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:22.998221 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95x2c" event={"ID":"4329ebd9-15fd-450a-8097-cc310c4cff77","Type":"ContainerStarted","Data":"e70c74c86f7e3ef83b65f534cd764d278b916f6e33ae110b73bf202d07aa1501"} Oct 30 12:57:22.998590 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:22.998239 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95x2c" event={"ID":"4329ebd9-15fd-450a-8097-cc310c4cff77","Type":"ContainerStarted","Data":"eaa93a333cf9704fb8a8923a7e210818b6df960aca193e44dc48106ef9a2509d"} Oct 30 12:57:25.007770 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.007731 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-95x2c" event={"ID":"4329ebd9-15fd-450a-8097-cc310c4cff77","Type":"ContainerStarted","Data":"1c612917ee07402a531872a06aec2864018304652a39df7a7f263a4fcf38dd94"} Oct 30 12:57:25.535803 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.535771 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-vh76f-djlcm"] Oct 30 12:57:25.539050 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.539026 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.566959 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.566933 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vh76f-djlcm"] Oct 30 12:57:25.574210 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.574176 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fc8cbbcf9-mxxnl"] Oct 30 12:57:25.577395 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.577379 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.579730 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.579709 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-s5lqq"] Oct 30 12:57:25.582510 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.582491 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.584346 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.584327 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58"] Oct 30 12:57:25.587174 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.587158 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:25.592784 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.592767 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5m274\"" Oct 30 12:57:25.592875 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.592863 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Oct 30 12:57:25.593127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.593115 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Oct 30 12:57:25.593180 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.593124 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Oct 30 12:57:25.593260 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.593229 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Oct 30 12:57:25.593380 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.593366 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Oct 30 12:57:25.596099 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.596076 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Oct 30 12:57:25.615483 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.615449 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc8cbbcf9-mxxnl"] Oct 30 12:57:25.618543 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.618516 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-s5lqq"] Oct 30 12:57:25.636375 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.636344 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58"] Oct 30 12:57:25.654529 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654499 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.654529 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654530 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.654758 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654610 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28vn9\" (UniqueName: \"kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.654758 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654676 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.654758 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654694 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.654758 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654718 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.654758 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654745 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.654961 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654800 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.654961 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654870 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drblb\" (UniqueName: \"kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.654961 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654891 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.654961 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.654910 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.665565 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.665536 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b8f957dd5-4dxtx"] Oct 30 12:57:25.668523 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.668507 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.692883 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.692858 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Oct 30 12:57:25.693070 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.693054 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pgtms\"" Oct 30 12:57:25.693123 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.693074 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Oct 30 12:57:25.693123 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.693093 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hp484\"" Oct 30 12:57:25.693123 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.693092 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Oct 30 12:57:25.693251 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.693133 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-2tfgc\"" Oct 30 12:57:25.693251 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.693160 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Oct 30 12:57:25.695350 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.695334 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Oct 30 12:57:25.714827 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.714802 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Oct 30 12:57:25.715781 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.715764 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8f957dd5-4dxtx"] Oct 30 12:57:25.755933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.755900 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.755933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.755937 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.756127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.755965 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.755991 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40212d18-1744-46fb-9f7c-f98424a813bb-ca-trust-extracted\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756017 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756040 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz2bg\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-kube-api-access-vz2bg\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756070 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.756127 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756093 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xplx\" (UniqueName: \"kubernetes.io/projected/06e8a16e-89cf-431d-bc3e-ccb9abcba60d-kube-api-access-7xplx\") pod \"downloads-6dd789c8b7-s5lqq\" (UID: \"06e8a16e-89cf-431d-bc3e-ccb9abcba60d\") " pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.756430 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756168 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drblb\" (UniqueName: \"kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.756493 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756437 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756493 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756447 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756493 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756470 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.756493 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756486 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40212d18-1744-46fb-9f7c-f98424a813bb-installation-pull-secrets\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756696 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756546 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756696 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756573 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756696 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756597 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.756696 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756620 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-registry-tls\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756696 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756676 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40212d18-1744-46fb-9f7c-f98424a813bb-image-registry-private-configuration\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756706 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-bound-sa-token\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756731 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40212d18-1744-46fb-9f7c-f98424a813bb-trusted-ca\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756760 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e8a16e-89cf-431d-bc3e-ccb9abcba60d-tmp\") pod \"downloads-6dd789c8b7-s5lqq\" (UID: \"06e8a16e-89cf-431d-bc3e-ccb9abcba60d\") " pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756787 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f273c797-0f60-46c7-9b27-61141af2819f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-8zp58\" (UID: \"f273c797-0f60-46c7-9b27-61141af2819f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756844 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756850 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40212d18-1744-46fb-9f7c-f98424a813bb-registry-certificates\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.756933 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.756915 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28vn9\" (UniqueName: \"kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.757377 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.757264 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.757377 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.757343 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.757449 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.757408 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.757613 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.757596 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.758790 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.758761 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.759535 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.759518 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.778713 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.778690 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28vn9\" (UniqueName: \"kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9\") pod \"console-6fc8cbbcf9-mxxnl\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.781957 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.781935 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drblb\" (UniqueName: \"kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb\") pod \"periodic-gathering-vh76f-djlcm\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.850070 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.849992 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:57:25.858320 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858288 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40212d18-1744-46fb-9f7c-f98424a813bb-image-registry-private-configuration\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.858446 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858329 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-bound-sa-token\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.858446 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858364 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40212d18-1744-46fb-9f7c-f98424a813bb-trusted-ca\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.858446 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858397 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e8a16e-89cf-431d-bc3e-ccb9abcba60d-tmp\") pod \"downloads-6dd789c8b7-s5lqq\" (UID: \"06e8a16e-89cf-431d-bc3e-ccb9abcba60d\") " pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.858446 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858423 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f273c797-0f60-46c7-9b27-61141af2819f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-8zp58\" (UID: \"f273c797-0f60-46c7-9b27-61141af2819f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858448 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40212d18-1744-46fb-9f7c-f98424a813bb-registry-certificates\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858500 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40212d18-1744-46fb-9f7c-f98424a813bb-ca-trust-extracted\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858528 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz2bg\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-kube-api-access-vz2bg\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858553 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xplx\" (UniqueName: \"kubernetes.io/projected/06e8a16e-89cf-431d-bc3e-ccb9abcba60d-kube-api-access-7xplx\") pod \"downloads-6dd789c8b7-s5lqq\" (UID: \"06e8a16e-89cf-431d-bc3e-ccb9abcba60d\") " pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858591 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40212d18-1744-46fb-9f7c-f98424a813bb-installation-pull-secrets\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858623 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-registry-tls\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858897 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06e8a16e-89cf-431d-bc3e-ccb9abcba60d-tmp\") pod \"downloads-6dd789c8b7-s5lqq\" (UID: \"06e8a16e-89cf-431d-bc3e-ccb9abcba60d\") " pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.859107 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.858906 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/40212d18-1744-46fb-9f7c-f98424a813bb-ca-trust-extracted\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859631 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.859604 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/40212d18-1744-46fb-9f7c-f98424a813bb-registry-certificates\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.859703 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.859652 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/40212d18-1744-46fb-9f7c-f98424a813bb-trusted-ca\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.861192 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.861120 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/40212d18-1744-46fb-9f7c-f98424a813bb-image-registry-private-configuration\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.861781 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.861759 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f273c797-0f60-46c7-9b27-61141af2819f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-8zp58\" (UID: \"f273c797-0f60-46c7-9b27-61141af2819f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:25.861869 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.861826 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-registry-tls\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.862109 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.862086 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/40212d18-1744-46fb-9f7c-f98424a813bb-installation-pull-secrets\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.881173 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.881151 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-bound-sa-token\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.886676 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.886654 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz2bg\" (UniqueName: \"kubernetes.io/projected/40212d18-1744-46fb-9f7c-f98424a813bb-kube-api-access-vz2bg\") pod \"image-registry-6b8f957dd5-4dxtx\" (UID: \"40212d18-1744-46fb-9f7c-f98424a813bb\") " pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:25.887134 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.887113 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xplx\" (UniqueName: \"kubernetes.io/projected/06e8a16e-89cf-431d-bc3e-ccb9abcba60d-kube-api-access-7xplx\") pod \"downloads-6dd789c8b7-s5lqq\" (UID: \"06e8a16e-89cf-431d-bc3e-ccb9abcba60d\") " pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.889108 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.888940 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:25.896009 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.895995 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:25.902221 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.901721 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:25.978667 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.978564 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lxnch" Oct 30 12:57:25.979687 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:25.979604 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:26.152450 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:26.152375 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-vh76f-djlcm"] Oct 30 12:57:26.155328 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:26.155303 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948d80ed_51a1_4cb3_97db_889bfa25f040.slice/crio-79e0a3c99abc777da6aebd0ac2a28c54890577fb82d9f9e271c0dfaaa45297a7 WatchSource:0}: Error finding container 79e0a3c99abc777da6aebd0ac2a28c54890577fb82d9f9e271c0dfaaa45297a7: Status 404 returned error can't find the container with id 79e0a3c99abc777da6aebd0ac2a28c54890577fb82d9f9e271c0dfaaa45297a7 Oct 30 12:57:26.209309 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:26.209227 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fc8cbbcf9-mxxnl"] Oct 30 12:57:26.212627 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:26.212605 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2b5782_fe4b_41b6_a234_6628c69798dd.slice/crio-a23c7457bb0def118a9c22c4c533aa94faa55d14cf34efdf1e07e8854273aa15 WatchSource:0}: Error finding container a23c7457bb0def118a9c22c4c533aa94faa55d14cf34efdf1e07e8854273aa15: Status 404 returned error can't find the container with id a23c7457bb0def118a9c22c4c533aa94faa55d14cf34efdf1e07e8854273aa15 Oct 30 12:57:26.219896 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:26.219874 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58"] Oct 30 12:57:26.220563 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:26.220538 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-s5lqq"] Oct 30 12:57:26.223297 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:26.223274 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e8a16e_89cf_431d_bc3e_ccb9abcba60d.slice/crio-0b05ff91a477fe758edde369ca913527358081a91cd82a018ca15beaf3593065 WatchSource:0}: Error finding container 0b05ff91a477fe758edde369ca913527358081a91cd82a018ca15beaf3593065: Status 404 returned error can't find the container with id 0b05ff91a477fe758edde369ca913527358081a91cd82a018ca15beaf3593065 Oct 30 12:57:26.223717 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:26.223701 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf273c797_0f60_46c7_9b27_61141af2819f.slice/crio-eacc22cf7d74f747f9f45bacd73202a68bcbaa8f0a486f58b3ead5ba437ba5c2 WatchSource:0}: Error finding container eacc22cf7d74f747f9f45bacd73202a68bcbaa8f0a486f58b3ead5ba437ba5c2: Status 404 returned error can't find the container with id eacc22cf7d74f747f9f45bacd73202a68bcbaa8f0a486f58b3ead5ba437ba5c2 Oct 30 12:57:26.283897 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:26.283864 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8f957dd5-4dxtx"] Oct 30 12:57:26.287238 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:26.287176 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40212d18_1744_46fb_9f7c_f98424a813bb.slice/crio-1d70cd16b72891f33ed2a512eec34b3308463164363342ba761ed29c1657b6f0 WatchSource:0}: Error finding container 1d70cd16b72891f33ed2a512eec34b3308463164363342ba761ed29c1657b6f0: Status 404 returned error can't find the container with id 1d70cd16b72891f33ed2a512eec34b3308463164363342ba761ed29c1657b6f0 Oct 30 12:57:27.018763 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.018724 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-s5lqq" event={"ID":"06e8a16e-89cf-431d-bc3e-ccb9abcba60d","Type":"ContainerStarted","Data":"0b05ff91a477fe758edde369ca913527358081a91cd82a018ca15beaf3593065"} Oct 30 12:57:27.020932 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.020745 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vh76f-djlcm" event={"ID":"948d80ed-51a1-4cb3-97db-889bfa25f040","Type":"ContainerStarted","Data":"42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677"} Oct 30 12:57:27.020932 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.020803 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vh76f-djlcm" event={"ID":"948d80ed-51a1-4cb3-97db-889bfa25f040","Type":"ContainerStarted","Data":"79e0a3c99abc777da6aebd0ac2a28c54890577fb82d9f9e271c0dfaaa45297a7"} Oct 30 12:57:27.022785 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.022530 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" event={"ID":"f273c797-0f60-46c7-9b27-61141af2819f","Type":"ContainerStarted","Data":"eacc22cf7d74f747f9f45bacd73202a68bcbaa8f0a486f58b3ead5ba437ba5c2"} Oct 30 12:57:27.024087 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.024063 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc8cbbcf9-mxxnl" event={"ID":"9d2b5782-fe4b-41b6-a234-6628c69798dd","Type":"ContainerStarted","Data":"a23c7457bb0def118a9c22c4c533aa94faa55d14cf34efdf1e07e8854273aa15"} Oct 30 12:57:27.027759 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.027735 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" event={"ID":"40212d18-1744-46fb-9f7c-f98424a813bb","Type":"ContainerStarted","Data":"bac116b186cd9be7bcd865d555d14a7d080c0aed9c031f9f16759a3a7b621935"} Oct 30 12:57:27.027866 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.027778 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" event={"ID":"40212d18-1744-46fb-9f7c-f98424a813bb","Type":"ContainerStarted","Data":"1d70cd16b72891f33ed2a512eec34b3308463164363342ba761ed29c1657b6f0"} Oct 30 12:57:27.028675 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.028304 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:27.058594 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.058543 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-vh76f-djlcm" podStartSLOduration=2.058526257 podStartE2EDuration="2.058526257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:27.058061103 +0000 UTC m=+22.288344238" watchObservedRunningTime="2026-10-30 12:57:27.058526257 +0000 UTC m=+22.288809396" Oct 30 12:57:27.101320 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.101253 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" podStartSLOduration=2.101234772 podStartE2EDuration="2.101234772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:27.100903627 +0000 UTC m=+22.331186762" watchObservedRunningTime="2026-10-30 12:57:27.101234772 +0000 UTC m=+22.331517909" Oct 30 12:57:27.530974 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.530903 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxnch_c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/dns/0.log" Oct 30 12:57:27.725330 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:27.725297 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxnch_c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/kube-rbac-proxy/0.log" Oct 30 12:57:28.033532 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:28.033443 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" event={"ID":"f273c797-0f60-46c7-9b27-61141af2819f","Type":"ContainerStarted","Data":"b265b106d24f0b48c3aa92dd73ad1e05fe21abc08d9637c5bd10ff00142fb89a"} Oct 30 12:57:28.034087 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:28.034070 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:28.039817 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:28.039770 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" Oct 30 12:57:28.071192 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:28.071142 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-8zp58" podStartSLOduration=1.9005567970000001 podStartE2EDuration="3.071130899s" totalImagesPullingTime="1.170574102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:28.070747533 +0000 UTC m=+23.301030670" watchObservedRunningTime="2026-10-30 12:57:28.071130899 +0000 UTC m=+23.301414030" Oct 30 12:57:28.122427 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:28.122308 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fghs2_2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23/dns-node-resolver/0.log" Oct 30 12:57:28.721937 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:28.721904 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b8f957dd5-4dxtx_40212d18-1744-46fb-9f7c-f98424a813bb/registry/0.log" Oct 30 12:57:29.521183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:29.521157 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zp996_6a613faa-490e-4961-b7c3-9e08092e06a5/node-ca/0.log" Oct 30 12:57:29.779145 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:29.779110 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 12:57:30.044784 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:30.044702 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc8cbbcf9-mxxnl" event={"ID":"9d2b5782-fe4b-41b6-a234-6628c69798dd","Type":"ContainerStarted","Data":"97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f"} Oct 30 12:57:30.084713 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:30.084659 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6fc8cbbcf9-mxxnl" podStartSLOduration=1.942310156 podStartE2EDuration="5.084644789s" totalImagesPullingTime="3.142334633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:30.084517961 +0000 UTC m=+25.314801100" watchObservedRunningTime="2026-10-30 12:57:30.084644789 +0000 UTC m=+25.314927924" Oct 30 12:57:30.121395 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:30.121366 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p4cbf_a09d8584-bdfc-427f-83fe-5fd6e197c315/serve-healthcheck-canary/0.log" Oct 30 12:57:33.895161 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:33.895128 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-79xb9"] Oct 30 12:57:33.900179 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:33.900160 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:33.975952 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:33.975798 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-skpfr\"" Oct 30 12:57:33.975952 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:33.975918 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Oct 30 12:57:33.976218 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:33.976119 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Oct 30 12:57:34.007324 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.007289 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Oct 30 12:57:34.007475 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.007380 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Oct 30 12:57:34.007475 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.007448 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Oct 30 12:57:34.007573 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.007506 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Oct 30 12:57:34.028914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.028882 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-metrics-client-ca\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029081 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.028931 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7g9g\" (UniqueName: \"kubernetes.io/projected/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-kube-api-access-b7g9g\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029081 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029029 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-accelerators-collector-config\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029081 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029062 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-sys\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029222 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029133 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-tls\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029222 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029160 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-root\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029222 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029176 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029372 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029219 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-textfile\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.029372 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.029246 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-wtmp\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130324 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130288 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-tls\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130324 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130327 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-root\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130367 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130388 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-textfile\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130409 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-wtmp\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130438 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-metrics-client-ca\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130464 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g9g\" (UniqueName: \"kubernetes.io/projected/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-kube-api-access-b7g9g\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130482 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-root\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130497 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-accelerators-collector-config\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130520 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-sys\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130580 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130570 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-wtmp\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130999 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130610 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-sys\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.130999 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.130801 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-textfile\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.131251 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.131163 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-metrics-client-ca\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.131251 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.131163 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-accelerators-collector-config\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.133655 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.133633 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.133778 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.133757 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-node-exporter-tls\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.157635 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.157562 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g9g\" (UniqueName: \"kubernetes.io/projected/5dc88003-99f6-424c-bf3e-37d4c0b1d57e-kube-api-access-b7g9g\") pod \"node-exporter-79xb9\" (UID: \"5dc88003-99f6-424c-bf3e-37d4c0b1d57e\") " pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:34.221008 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:34.220973 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-79xb9" Oct 30 12:57:35.069775 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:35.069737 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79xb9" event={"ID":"5dc88003-99f6-424c-bf3e-37d4c0b1d57e","Type":"ContainerStarted","Data":"71284d39bd0c36a37bc33d6627897fac419afc03dcf3076bbcf83aed6897874e"} Oct 30 12:57:35.889598 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:35.889570 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:35.889747 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:35.889636 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:35.894914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:35.894892 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:36.075311 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:36.075268 4498 generic.go:356] "Generic (PLEG): container finished" podID="5dc88003-99f6-424c-bf3e-37d4c0b1d57e" containerID="aece0453f763774ceb1edec807f40b5ac271fbeaf2c313f73371c0ca73988167" exitCode=0 Oct 30 12:57:36.075760 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:36.075362 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79xb9" event={"ID":"5dc88003-99f6-424c-bf3e-37d4c0b1d57e","Type":"ContainerDied","Data":"aece0453f763774ceb1edec807f40b5ac271fbeaf2c313f73371c0ca73988167"} Oct 30 12:57:36.080328 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:36.080304 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:57:37.082133 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.082104 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79xb9" event={"ID":"5dc88003-99f6-424c-bf3e-37d4c0b1d57e","Type":"ContainerStarted","Data":"a1887c696f40fb88830966eb2b25fa00faed297c674fca3fb76c310fd66b5325"} Oct 30 12:57:37.082646 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.082161 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-79xb9" event={"ID":"5dc88003-99f6-424c-bf3e-37d4c0b1d57e","Type":"ContainerStarted","Data":"bfe2faeea14c5942445c78de77ad89041f6caa2831821b9c761a903419768494"} Oct 30 12:57:37.164190 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.164161 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb65b656-fvtgv"] Oct 30 12:57:37.173979 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.173934 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-79xb9" podStartSLOduration=2.661818707 podStartE2EDuration="4.17392188s" totalImagesPullingTime="1.413204308s" totalInitContainerRuntime="98.898865ms" isStatefulPod=true podCreationTimestamp="2026-10-30 12:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:37.165183937 +0000 UTC m=+32.395467073" watchObservedRunningTime="2026-10-30 12:57:37.17392188 +0000 UTC m=+32.404205016" Oct 30 12:57:37.180450 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.180420 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.192858 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.192833 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb65b656-fvtgv"] Oct 30 12:57:37.216628 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.216602 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Oct 30 12:57:37.253398 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253367 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253408 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253435 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253455 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253475 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253503 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253517 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.253566 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.253537 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99z46\" (UniqueName: \"kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.353986 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.353916 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.353986 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.353953 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.353986 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.353974 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354292 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354040 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354292 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354077 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354292 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354126 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354292 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354154 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354826 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354799 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354953 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354856 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354953 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354859 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99z46\" (UniqueName: \"kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.354953 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.354860 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.355118 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.355019 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.355312 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.355278 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.356847 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.356827 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.357704 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.357682 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.379003 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.378976 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99z46\" (UniqueName: \"kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46\") pod \"console-7bb65b656-fvtgv\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.501741 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.501706 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:37.837325 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:37.837108 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb65b656-fvtgv"] Oct 30 12:57:37.840021 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:37.839987 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1be1498_c9db_423e_9512_86085a2d3441.slice/crio-be91fccbe363e724f637573941c2f8e106170eb6dfdf762424f04efed3b87620 WatchSource:0}: Error finding container be91fccbe363e724f637573941c2f8e106170eb6dfdf762424f04efed3b87620: Status 404 returned error can't find the container with id be91fccbe363e724f637573941c2f8e106170eb6dfdf762424f04efed3b87620 Oct 30 12:57:38.087377 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:38.087293 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb65b656-fvtgv" event={"ID":"f1be1498-c9db-423e-9512-86085a2d3441","Type":"ContainerStarted","Data":"4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293"} Oct 30 12:57:38.087377 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:38.087358 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb65b656-fvtgv" event={"ID":"f1be1498-c9db-423e-9512-86085a2d3441","Type":"ContainerStarted","Data":"be91fccbe363e724f637573941c2f8e106170eb6dfdf762424f04efed3b87620"} Oct 30 12:57:38.128331 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:38.128276 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7bb65b656-fvtgv" podStartSLOduration=1.1282573280000001 podStartE2EDuration="1.128257328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:38.12703262 +0000 UTC m=+33.357315754" watchObservedRunningTime="2026-10-30 12:57:38.128257328 +0000 UTC m=+33.358540485" Oct 30 12:57:38.683630 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:38.683594 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ng2cv" Oct 30 12:57:43.111622 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:43.111580 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-s5lqq" event={"ID":"06e8a16e-89cf-431d-bc3e-ccb9abcba60d","Type":"ContainerStarted","Data":"de12648c5d661010e92e2ddbfa72020159eefe4c3e889d33ccc59c7bb0c43bed"} Oct 30 12:57:43.112125 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:43.111819 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:43.130795 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:43.130765 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-s5lqq" Oct 30 12:57:43.187060 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:43.186989 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-s5lqq" podStartSLOduration=1.788547195 podStartE2EDuration="18.186970252s" totalImagesPullingTime="16.398423057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:43.176244831 +0000 UTC m=+38.406527969" watchObservedRunningTime="2026-10-30 12:57:43.186970252 +0000 UTC m=+38.417253389" Oct 30 12:57:47.145258 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.145086 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb65b656-fvtgv"] Oct 30 12:57:47.176031 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.174922 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-f556cb557-2q542"] Oct 30 12:57:47.200243 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.200176 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f556cb557-2q542"] Oct 30 12:57:47.200515 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.200257 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241340 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241300 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241525 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241365 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241525 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241436 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdntq\" (UniqueName: \"kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241630 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241537 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241630 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241584 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241733 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241666 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241733 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241703 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.241833 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.241753 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342666 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342625 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342851 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342699 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342851 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342737 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342851 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342762 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdntq\" (UniqueName: \"kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342851 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342794 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342851 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342826 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.342851 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342854 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.343175 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.342884 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.343348 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.343324 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.343557 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.343529 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.343668 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.343638 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.343947 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.343928 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.344249 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.344227 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.346724 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.346693 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.350151 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.349348 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.367002 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.366953 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdntq\" (UniqueName: \"kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq\") pod \"console-f556cb557-2q542\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.502824 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.502790 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:57:47.546371 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.546335 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:47.904347 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:47.900898 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f556cb557-2q542"] Oct 30 12:57:47.907621 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:57:47.907580 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9830ddc4_0055_4e6f_accc_0fbad8c1f5dc.slice/crio-29cf48e6400665d8c09a7463f29c47574d418bd8c5cd3b171cebfe30a7800ecd WatchSource:0}: Error finding container 29cf48e6400665d8c09a7463f29c47574d418bd8c5cd3b171cebfe30a7800ecd: Status 404 returned error can't find the container with id 29cf48e6400665d8c09a7463f29c47574d418bd8c5cd3b171cebfe30a7800ecd Oct 30 12:57:48.132101 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:48.132052 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f556cb557-2q542" event={"ID":"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc","Type":"ContainerStarted","Data":"4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac"} Oct 30 12:57:48.132303 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:48.132147 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f556cb557-2q542" event={"ID":"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc","Type":"ContainerStarted","Data":"29cf48e6400665d8c09a7463f29c47574d418bd8c5cd3b171cebfe30a7800ecd"} Oct 30 12:57:48.183719 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:48.183666 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-f556cb557-2q542" podStartSLOduration=1.183650279 podStartE2EDuration="1.183650279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:57:48.172215531 +0000 UTC m=+43.402498671" watchObservedRunningTime="2026-10-30 12:57:48.183650279 +0000 UTC m=+43.413933415" Oct 30 12:57:49.043169 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:49.043143 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b8f957dd5-4dxtx" Oct 30 12:57:57.546548 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:57.546512 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:57.547119 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:57.546601 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:57.551431 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:57.551409 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:58.028615 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.028579 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-2j9r4-hrv7r"] Oct 30 12:57:58.028805 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.028754 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" podUID="62c000fd-3f35-44e1-8c56-dea1099fd496" containerName="insights-gathering" containerID="cri-o://5b942130332e51eba59e59c34bdc80ffb0a503b03def46fdc6737929b16759f4" gracePeriod=30 Oct 30 12:57:58.169759 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.169694 4498 generic.go:356] "Generic (PLEG): container finished" podID="62c000fd-3f35-44e1-8c56-dea1099fd496" containerID="5b942130332e51eba59e59c34bdc80ffb0a503b03def46fdc6737929b16759f4" exitCode=2 Oct 30 12:57:58.169885 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.169763 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" event={"ID":"62c000fd-3f35-44e1-8c56-dea1099fd496","Type":"ContainerDied","Data":"5b942130332e51eba59e59c34bdc80ffb0a503b03def46fdc6737929b16759f4"} Oct 30 12:57:58.173927 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.173904 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:57:58.247378 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.247350 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc8cbbcf9-mxxnl"] Oct 30 12:57:58.349555 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.349534 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:58.438807 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.438781 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") pod \"62c000fd-3f35-44e1-8c56-dea1099fd496\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " Oct 30 12:57:58.438973 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.438830 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") pod \"62c000fd-3f35-44e1-8c56-dea1099fd496\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " Oct 30 12:57:58.438973 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.438852 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") pod \"62c000fd-3f35-44e1-8c56-dea1099fd496\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " Oct 30 12:57:58.439100 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.438975 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") pod \"62c000fd-3f35-44e1-8c56-dea1099fd496\" (UID: \"62c000fd-3f35-44e1-8c56-dea1099fd496\") " Oct 30 12:57:58.439250 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.439223 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle" pod "62c000fd-3f35-44e1-8c56-dea1099fd496" (UID: "62c000fd-3f35-44e1-8c56-dea1099fd496"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:57:58.439250 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.439237 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle" pod "62c000fd-3f35-44e1-8c56-dea1099fd496" (UID: "62c000fd-3f35-44e1-8c56-dea1099fd496"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:57:58.439349 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.439294 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path" pod "62c000fd-3f35-44e1-8c56-dea1099fd496" (UID: "62c000fd-3f35-44e1-8c56-dea1099fd496"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 12:57:58.441183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.441162 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst" pod "62c000fd-3f35-44e1-8c56-dea1099fd496" (UID: "62c000fd-3f35-44e1-8c56-dea1099fd496"). InnerVolumeSpecName "kube-api-access-rktst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 12:57:58.539530 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.539498 4498 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-trusted-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:57:58.539530 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.539525 4498 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62c000fd-3f35-44e1-8c56-dea1099fd496-service-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:57:58.539530 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.539534 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rktst\" (UniqueName: \"kubernetes.io/projected/62c000fd-3f35-44e1-8c56-dea1099fd496-kube-api-access-rktst\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:57:58.539739 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:58.539544 4498 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/62c000fd-3f35-44e1-8c56-dea1099fd496-archives-path\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:57:59.174614 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:59.174533 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" Oct 30 12:57:59.174614 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:59.174574 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-2j9r4-hrv7r" event={"ID":"62c000fd-3f35-44e1-8c56-dea1099fd496","Type":"ContainerDied","Data":"69d40b18a793bccb5d73bacfbadb3398c238279e1867783f7dde903efefb1f7a"} Oct 30 12:57:59.175128 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:59.174623 4498 scope.go:122] "RemoveContainer" containerID="5b942130332e51eba59e59c34bdc80ffb0a503b03def46fdc6737929b16759f4" Oct 30 12:57:59.219137 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:59.219110 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-2j9r4-hrv7r"] Oct 30 12:57:59.229387 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:57:59.229362 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-2j9r4-hrv7r"] Oct 30 12:57:59.774758 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:57:59.774724 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 12:58:00.898264 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:00.898233 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62c000fd-3f35-44e1-8c56-dea1099fd496" path="/var/lib/kubelet/pods/62c000fd-3f35-44e1-8c56-dea1099fd496/volumes" Oct 30 12:58:12.172971 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.172903 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7bb65b656-fvtgv" podUID="f1be1498-c9db-423e-9512-86085a2d3441" containerName="console" containerID="cri-o://4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293" gracePeriod=15 Oct 30 12:58:12.457490 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.457463 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:58:12.548277 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548246 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548440 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548291 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548440 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548326 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46\" (UniqueName: \"kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548440 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548349 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548440 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548376 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548440 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548396 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548656 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548441 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548656 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548521 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert\") pod \"f1be1498-c9db-423e-9512-86085a2d3441\" (UID: \"f1be1498-c9db-423e-9512-86085a2d3441\") " Oct 30 12:58:12.548656 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548615 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 12:58:12.548807 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548675 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:12.548868 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548815 4498 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1be1498-c9db-423e-9512-86085a2d3441-tmp\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.548868 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548833 4498 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-trusted-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.548948 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548916 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:12.548991 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548957 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:12.548991 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.548972 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:12.550841 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.550813 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 12:58:12.550841 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.550823 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "kube-api-access-99z46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 12:58:12.550977 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.550867 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert" pod "f1be1498-c9db-423e-9512-86085a2d3441" (UID: "f1be1498-c9db-423e-9512-86085a2d3441"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 12:58:12.649499 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.649475 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99z46\" (UniqueName: \"kubernetes.io/projected/f1be1498-c9db-423e-9512-86085a2d3441-kube-api-access-99z46\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.649499 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.649497 4498 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-oauth-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.649672 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.649508 4498 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.649672 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.649516 4498 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-oauth-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.649672 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.649525 4498 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1be1498-c9db-423e-9512-86085a2d3441-console-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:12.649672 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:12.649533 4498 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1be1498-c9db-423e-9512-86085a2d3441-console-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:13.225511 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.225484 4498 generic.go:356] "Generic (PLEG): container finished" podID="f1be1498-c9db-423e-9512-86085a2d3441" containerID="4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293" exitCode=0 Oct 30 12:58:13.225912 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.225532 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb65b656-fvtgv" Oct 30 12:58:13.225912 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.225559 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb65b656-fvtgv" event={"ID":"f1be1498-c9db-423e-9512-86085a2d3441","Type":"ContainerDied","Data":"4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293"} Oct 30 12:58:13.225912 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.225597 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb65b656-fvtgv" event={"ID":"f1be1498-c9db-423e-9512-86085a2d3441","Type":"ContainerDied","Data":"be91fccbe363e724f637573941c2f8e106170eb6dfdf762424f04efed3b87620"} Oct 30 12:58:13.225912 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.225615 4498 scope.go:122] "RemoveContainer" containerID="4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293" Oct 30 12:58:13.233516 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.233485 4498 scope.go:122] "RemoveContainer" containerID="4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293" Oct 30 12:58:13.233786 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:58:13.233764 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293\": container with ID starting with 4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293 not found: ID does not exist" containerID="4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293" Oct 30 12:58:13.233855 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.233794 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293"} err="failed to get container status \"4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293\": rpc error: code = NotFound desc = could not find container \"4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293\": container with ID starting with 4f26938d9f5ee6750caa43e73ea251747fe9700f34bbcffc599498b105723293 not found: ID does not exist" Oct 30 12:58:13.271864 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.271841 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb65b656-fvtgv"] Oct 30 12:58:13.282464 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:13.282444 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb65b656-fvtgv"] Oct 30 12:58:14.898052 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:14.898019 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f1be1498-c9db-423e-9512-86085a2d3441" path="/var/lib/kubelet/pods/f1be1498-c9db-423e-9512-86085a2d3441/volumes" Oct 30 12:58:23.269187 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.269127 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6fc8cbbcf9-mxxnl" podUID="9d2b5782-fe4b-41b6-a234-6628c69798dd" containerName="console" containerID="cri-o://97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f" gracePeriod=15 Oct 30 12:58:23.535697 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.535630 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:58:23.630667 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630627 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.630863 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630679 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9\" (UniqueName: \"kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.630863 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630721 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.630863 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630778 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.630863 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630808 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.630863 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630836 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.631104 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.630896 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca\") pod \"9d2b5782-fe4b-41b6-a234-6628c69798dd\" (UID: \"9d2b5782-fe4b-41b6-a234-6628c69798dd\") " Oct 30 12:58:23.631157 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.631125 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:23.631293 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.631266 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 12:58:23.631401 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.631306 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:23.631401 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.631370 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:23.633078 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.633056 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 12:58:23.633078 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.633072 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "kube-api-access-28vn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 12:58:23.633481 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.633460 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config" pod "9d2b5782-fe4b-41b6-a234-6628c69798dd" (UID: "9d2b5782-fe4b-41b6-a234-6628c69798dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 12:58:23.731622 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731587 4498 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-oauth-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:23.731622 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731617 4498 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-oauth-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:23.731622 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731627 4498 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d2b5782-fe4b-41b6-a234-6628c69798dd-tmp\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:23.731845 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731637 4498 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:23.731845 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731646 4498 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:23.731845 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731654 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28vn9\" (UniqueName: \"kubernetes.io/projected/9d2b5782-fe4b-41b6-a234-6628c69798dd-kube-api-access-28vn9\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:23.731845 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:23.731663 4498 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2b5782-fe4b-41b6-a234-6628c69798dd-console-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:24.260626 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.260591 4498 generic.go:356] "Generic (PLEG): container finished" podID="9d2b5782-fe4b-41b6-a234-6628c69798dd" containerID="97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f" exitCode=0 Oct 30 12:58:24.260822 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.260645 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc8cbbcf9-mxxnl" event={"ID":"9d2b5782-fe4b-41b6-a234-6628c69798dd","Type":"ContainerDied","Data":"97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f"} Oct 30 12:58:24.260822 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.260665 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fc8cbbcf9-mxxnl" Oct 30 12:58:24.260822 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.260709 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fc8cbbcf9-mxxnl" event={"ID":"9d2b5782-fe4b-41b6-a234-6628c69798dd","Type":"ContainerDied","Data":"a23c7457bb0def118a9c22c4c533aa94faa55d14cf34efdf1e07e8854273aa15"} Oct 30 12:58:24.260822 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.260729 4498 scope.go:122] "RemoveContainer" containerID="97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f" Oct 30 12:58:24.269575 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.269556 4498 scope.go:122] "RemoveContainer" containerID="97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f" Oct 30 12:58:24.269918 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:58:24.269822 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f\": container with ID starting with 97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f not found: ID does not exist" containerID="97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f" Oct 30 12:58:24.269918 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.269848 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f"} err="failed to get container status \"97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f\": rpc error: code = NotFound desc = could not find container \"97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f\": container with ID starting with 97c4a06290cc1ffa8af244680d221d204d3f96f39c8391fe7d01aee9c8a3c74f not found: ID does not exist" Oct 30 12:58:24.305327 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.305294 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fc8cbbcf9-mxxnl"] Oct 30 12:58:24.315465 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.315411 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fc8cbbcf9-mxxnl"] Oct 30 12:58:24.898094 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:24.898067 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d2b5782-fe4b-41b6-a234-6628c69798dd" path="/var/lib/kubelet/pods/9d2b5782-fe4b-41b6-a234-6628c69798dd/volumes" Oct 30 12:58:26.962721 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:26.962689 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vh76f-djlcm"] Oct 30 12:58:26.963131 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:26.962871 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-vh76f-djlcm" podUID="948d80ed-51a1-4cb3-97db-889bfa25f040" containerName="insights-gathering" containerID="cri-o://42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677" gracePeriod=30 Oct 30 12:58:27.259038 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.259010 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:58:27.271943 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.271911 4498 generic.go:356] "Generic (PLEG): container finished" podID="948d80ed-51a1-4cb3-97db-889bfa25f040" containerID="42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677" exitCode=2 Oct 30 12:58:27.271943 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.271948 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-vh76f-djlcm" Oct 30 12:58:27.271943 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.271966 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vh76f-djlcm" event={"ID":"948d80ed-51a1-4cb3-97db-889bfa25f040","Type":"ContainerDied","Data":"42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677"} Oct 30 12:58:27.272171 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.272009 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-vh76f-djlcm" event={"ID":"948d80ed-51a1-4cb3-97db-889bfa25f040","Type":"ContainerDied","Data":"79e0a3c99abc777da6aebd0ac2a28c54890577fb82d9f9e271c0dfaaa45297a7"} Oct 30 12:58:27.272171 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.272038 4498 scope.go:122] "RemoveContainer" containerID="42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677" Oct 30 12:58:27.279563 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.279547 4498 scope.go:122] "RemoveContainer" containerID="42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677" Oct 30 12:58:27.279823 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:58:27.279805 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677\": container with ID starting with 42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677 not found: ID does not exist" containerID="42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677" Oct 30 12:58:27.279876 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.279835 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677"} err="failed to get container status \"42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677\": rpc error: code = NotFound desc = could not find container \"42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677\": container with ID starting with 42ed43a76b3da622035b1816a456a928fb7e7016ca4209d4e2020096eef93677 not found: ID does not exist" Oct 30 12:58:27.360368 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360334 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle\") pod \"948d80ed-51a1-4cb3-97db-889bfa25f040\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " Oct 30 12:58:27.360368 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360374 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path\") pod \"948d80ed-51a1-4cb3-97db-889bfa25f040\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " Oct 30 12:58:27.360617 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360397 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb\" (UniqueName: \"kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb\") pod \"948d80ed-51a1-4cb3-97db-889bfa25f040\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " Oct 30 12:58:27.360617 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360566 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle\") pod \"948d80ed-51a1-4cb3-97db-889bfa25f040\" (UID: \"948d80ed-51a1-4cb3-97db-889bfa25f040\") " Oct 30 12:58:27.360914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360733 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path" pod "948d80ed-51a1-4cb3-97db-889bfa25f040" (UID: "948d80ed-51a1-4cb3-97db-889bfa25f040"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 12:58:27.360914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360760 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle" pod "948d80ed-51a1-4cb3-97db-889bfa25f040" (UID: "948d80ed-51a1-4cb3-97db-889bfa25f040"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:27.360914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360879 4498 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-trusted-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:27.360914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360886 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle" pod "948d80ed-51a1-4cb3-97db-889bfa25f040" (UID: "948d80ed-51a1-4cb3-97db-889bfa25f040"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:58:27.360914 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.360895 4498 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/948d80ed-51a1-4cb3-97db-889bfa25f040-archives-path\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:27.362708 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.362687 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb" pod "948d80ed-51a1-4cb3-97db-889bfa25f040" (UID: "948d80ed-51a1-4cb3-97db-889bfa25f040"). InnerVolumeSpecName "kube-api-access-drblb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 12:58:27.461984 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.461961 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drblb\" (UniqueName: \"kubernetes.io/projected/948d80ed-51a1-4cb3-97db-889bfa25f040-kube-api-access-drblb\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:27.461984 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.461981 4498 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/948d80ed-51a1-4cb3-97db-889bfa25f040-service-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:58:27.611775 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.611743 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-vh76f-djlcm"] Oct 30 12:58:27.613437 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:27.613415 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-vh76f-djlcm"] Oct 30 12:58:28.897850 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:28.897818 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="948d80ed-51a1-4cb3-97db-889bfa25f040" path="/var/lib/kubelet/pods/948d80ed-51a1-4cb3-97db-889bfa25f040/volumes" Oct 30 12:58:29.773626 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:58:29.773592 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 12:58:32.459930 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.459895 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-65f4f4dcbb-bvvc4"] Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460129 4498 cpu_manager.go:414] "containerMap: removing container" podUID="948d80ed-51a1-4cb3-97db-889bfa25f040" containerName="insights-gathering" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460140 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="948d80ed-51a1-4cb3-97db-889bfa25f040" containerName="insights-gathering" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460153 4498 cpu_manager.go:414] "containerMap: removing container" podUID="62c000fd-3f35-44e1-8c56-dea1099fd496" containerName="insights-gathering" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460158 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62c000fd-3f35-44e1-8c56-dea1099fd496" containerName="insights-gathering" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460169 4498 cpu_manager.go:414] "containerMap: removing container" podUID="9d2b5782-fe4b-41b6-a234-6628c69798dd" containerName="console" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460174 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d2b5782-fe4b-41b6-a234-6628c69798dd" containerName="console" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460188 4498 cpu_manager.go:414] "containerMap: removing container" podUID="f1be1498-c9db-423e-9512-86085a2d3441" containerName="console" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460193 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f1be1498-c9db-423e-9512-86085a2d3441" containerName="console" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460259 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d2b5782-fe4b-41b6-a234-6628c69798dd" containerName="console" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460267 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="f1be1498-c9db-423e-9512-86085a2d3441" containerName="console" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460274 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="948d80ed-51a1-4cb3-97db-889bfa25f040" containerName="insights-gathering" Oct 30 12:58:32.460310 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.460280 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="62c000fd-3f35-44e1-8c56-dea1099fd496" containerName="insights-gathering" Oct 30 12:58:32.462787 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.462770 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.490447 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.490411 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f4f4dcbb-bvvc4"] Oct 30 12:58:32.594911 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.594875 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.594911 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.594914 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p8rl\" (UniqueName: \"kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.595183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.594943 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.595183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.595021 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.595183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.595065 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.595183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.595133 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.595183 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.595181 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.595425 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.595242 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.695766 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.695723 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.695766 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.695763 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p8rl\" (UniqueName: \"kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.695992 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.695787 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.695992 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.695805 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.695992 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.695930 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.695992 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.695987 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696229 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696040 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696229 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696073 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696459 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696436 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696682 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696658 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696783 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696668 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696783 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696565 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.696986 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.696965 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.698392 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.698369 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.698511 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.698490 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.717691 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.717643 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p8rl\" (UniqueName: \"kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl\") pod \"console-65f4f4dcbb-bvvc4\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:32.772540 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:32.772513 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:33.069861 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:33.069786 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65f4f4dcbb-bvvc4"] Oct 30 12:58:33.072620 ip-10-0-130-34 kubenswrapper[4498]: W1030 12:58:33.072583 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbeb6d46_5571_45e0_857e_21e6224c014e.slice/crio-44ab12a557b1f2898b6d175989ff5f06c9e0b460d6a321b4e45ee01e04e5b97d WatchSource:0}: Error finding container 44ab12a557b1f2898b6d175989ff5f06c9e0b460d6a321b4e45ee01e04e5b97d: Status 404 returned error can't find the container with id 44ab12a557b1f2898b6d175989ff5f06c9e0b460d6a321b4e45ee01e04e5b97d Oct 30 12:58:33.293057 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:33.293025 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4f4dcbb-bvvc4" event={"ID":"bbeb6d46-5571-45e0-857e-21e6224c014e","Type":"ContainerStarted","Data":"c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d"} Oct 30 12:58:33.293261 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:33.293077 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4f4dcbb-bvvc4" event={"ID":"bbeb6d46-5571-45e0-857e-21e6224c014e","Type":"ContainerStarted","Data":"44ab12a557b1f2898b6d175989ff5f06c9e0b460d6a321b4e45ee01e04e5b97d"} Oct 30 12:58:33.333563 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:33.333463 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-65f4f4dcbb-bvvc4" podStartSLOduration=1.333447791 podStartE2EDuration="1.333447791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 12:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 12:58:33.332548736 +0000 UTC m=+88.562831871" watchObservedRunningTime="2026-10-30 12:58:33.333447791 +0000 UTC m=+88.563730997" Oct 30 12:58:42.773387 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:42.773349 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:42.773786 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:42.773413 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:42.777924 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:42.777906 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:43.328894 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:43.328866 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 12:58:43.413350 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:58:43.413187 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f556cb557-2q542"] Oct 30 12:58:59.773444 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:58:59.773405 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 12:59:08.433052 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.432986 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-f556cb557-2q542" podUID="9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" containerName="console" containerID="cri-o://4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac" gracePeriod=15 Oct 30 12:59:08.664540 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.664515 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:59:08.746089 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746005 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746089 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746053 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746089 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746075 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746404 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746118 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746404 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746141 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746404 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746185 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp\" (UniqueName: \"kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746404 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746265 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746651 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746549 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 12:59:08.746651 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746547 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:59:08.746651 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746574 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq\" (UniqueName: \"kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq\") pod \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\" (UID: \"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc\") " Oct 30 12:59:08.746651 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746588 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:59:08.746651 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746616 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:59:08.746651 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746626 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 12:59:08.746840 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746794 4498 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-oauth-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.746840 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746815 4498 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.746840 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746830 4498 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-tmp\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.746976 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746842 4498 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.746976 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.746853 4498 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-trusted-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.748495 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.748470 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 12:59:08.748604 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.748587 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 12:59:08.748647 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.748613 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq" pod "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" (UID: "9830ddc4-0055-4e6f-accc-0fbad8c1f5dc"). InnerVolumeSpecName "kube-api-access-cdntq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 12:59:08.848064 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.848011 4498 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-oauth-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.848064 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.848057 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdntq\" (UniqueName: \"kubernetes.io/projected/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-kube-api-access-cdntq\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:08.848064 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:08.848070 4498 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc-console-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 12:59:09.413210 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.413170 4498 generic.go:356] "Generic (PLEG): container finished" podID="9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" containerID="4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac" exitCode=0 Oct 30 12:59:09.413374 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.413236 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f556cb557-2q542" Oct 30 12:59:09.413374 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.413231 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f556cb557-2q542" event={"ID":"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc","Type":"ContainerDied","Data":"4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac"} Oct 30 12:59:09.413374 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.413349 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f556cb557-2q542" event={"ID":"9830ddc4-0055-4e6f-accc-0fbad8c1f5dc","Type":"ContainerDied","Data":"29cf48e6400665d8c09a7463f29c47574d418bd8c5cd3b171cebfe30a7800ecd"} Oct 30 12:59:09.413473 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.413374 4498 scope.go:122] "RemoveContainer" containerID="4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac" Oct 30 12:59:09.421136 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.421119 4498 scope.go:122] "RemoveContainer" containerID="4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac" Oct 30 12:59:09.421432 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:59:09.421414 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac\": container with ID starting with 4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac not found: ID does not exist" containerID="4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac" Oct 30 12:59:09.421494 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.421442 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac"} err="failed to get container status \"4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac\": rpc error: code = NotFound desc = could not find container \"4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac\": container with ID starting with 4271f6eaff5c49e7f96997c1da76ca173d9ab88085f2bc93976c32a926dd96ac not found: ID does not exist" Oct 30 12:59:09.458111 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.458083 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f556cb557-2q542"] Oct 30 12:59:09.468530 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:09.468499 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f556cb557-2q542"] Oct 30 12:59:10.897368 ip-10-0-130-34 kubenswrapper[4498]: I1030 12:59:10.897342 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" path="/var/lib/kubelet/pods/9830ddc4-0055-4e6f-accc-0fbad8c1f5dc/volumes" Oct 30 12:59:29.774833 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:59:29.774743 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 12:59:59.773993 ip-10-0-130-34 kubenswrapper[4498]: E1030 12:59:59.773950 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:00:09.709438 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.709406 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-784fdc9f45-5pn68"] Oct 30 13:00:09.709839 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.709737 4498 cpu_manager.go:414] "containerMap: removing container" podUID="9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" containerName="console" Oct 30 13:00:09.709839 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.709751 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" containerName="console" Oct 30 13:00:09.709839 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.709800 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="9830ddc4-0055-4e6f-accc-0fbad8c1f5dc" containerName="console" Oct 30 13:00:09.713792 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.713772 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.733969 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.733937 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784fdc9f45-5pn68"] Oct 30 13:00:09.874366 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874327 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a897b056-476b-4ea0-918d-96762f60c5f3-console-oauth-config\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874377 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-console-config\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874394 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-trusted-ca-bundle\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874524 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-service-ca\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874559 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a897b056-476b-4ea0-918d-96762f60c5f3-console-serving-cert\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874580 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-oauth-serving-cert\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874708 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x65xg\" (UniqueName: \"kubernetes.io/projected/a897b056-476b-4ea0-918d-96762f60c5f3-kube-api-access-x65xg\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.874858 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.874741 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a897b056-476b-4ea0-918d-96762f60c5f3-tmp\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976007 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.975902 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-service-ca\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976007 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.975957 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a897b056-476b-4ea0-918d-96762f60c5f3-console-serving-cert\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976007 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.975979 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-oauth-serving-cert\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976007 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976006 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x65xg\" (UniqueName: \"kubernetes.io/projected/a897b056-476b-4ea0-918d-96762f60c5f3-kube-api-access-x65xg\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976026 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a897b056-476b-4ea0-918d-96762f60c5f3-tmp\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976056 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a897b056-476b-4ea0-918d-96762f60c5f3-console-oauth-config\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976091 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-console-config\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976118 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-trusted-ca-bundle\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976795 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976768 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a897b056-476b-4ea0-918d-96762f60c5f3-tmp\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976892 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976768 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-service-ca\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976892 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976768 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-oauth-serving-cert\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.976892 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.976848 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-console-config\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.977073 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.977059 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a897b056-476b-4ea0-918d-96762f60c5f3-trusted-ca-bundle\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.979120 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.979097 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a897b056-476b-4ea0-918d-96762f60c5f3-console-serving-cert\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.979120 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.979111 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a897b056-476b-4ea0-918d-96762f60c5f3-console-oauth-config\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:09.998135 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:09.998106 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x65xg\" (UniqueName: \"kubernetes.io/projected/a897b056-476b-4ea0-918d-96762f60c5f3-kube-api-access-x65xg\") pod \"console-784fdc9f45-5pn68\" (UID: \"a897b056-476b-4ea0-918d-96762f60c5f3\") " pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:10.024662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:10.024628 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:10.338019 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:10.337946 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784fdc9f45-5pn68"] Oct 30 13:00:10.342749 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:00:10.342714 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda897b056_476b_4ea0_918d_96762f60c5f3.slice/crio-d6214803ccad3487b3e9703fac3a5e67924ef1d396852b4db8cd0172e9d8fdc6 WatchSource:0}: Error finding container d6214803ccad3487b3e9703fac3a5e67924ef1d396852b4db8cd0172e9d8fdc6: Status 404 returned error can't find the container with id d6214803ccad3487b3e9703fac3a5e67924ef1d396852b4db8cd0172e9d8fdc6 Oct 30 13:00:10.604482 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:10.604390 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784fdc9f45-5pn68" event={"ID":"a897b056-476b-4ea0-918d-96762f60c5f3","Type":"ContainerStarted","Data":"0a2bd609dc1c103aca972ae57bb7098b87319584208bcc101ad17188c99d3302"} Oct 30 13:00:10.604482 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:10.604450 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784fdc9f45-5pn68" event={"ID":"a897b056-476b-4ea0-918d-96762f60c5f3","Type":"ContainerStarted","Data":"d6214803ccad3487b3e9703fac3a5e67924ef1d396852b4db8cd0172e9d8fdc6"} Oct 30 13:00:10.644040 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:10.643973 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-784fdc9f45-5pn68" podStartSLOduration=1.643953585 podStartE2EDuration="1.643953585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:00:10.643376999 +0000 UTC m=+185.873660160" watchObservedRunningTime="2026-10-30 13:00:10.643953585 +0000 UTC m=+185.874236723" Oct 30 13:00:20.025562 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:20.025519 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:20.025998 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:20.025592 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:20.030541 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:20.030518 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:20.640979 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:20.640954 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-784fdc9f45-5pn68" Oct 30 13:00:20.739917 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:20.739885 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f4f4dcbb-bvvc4"] Oct 30 13:00:29.774180 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:00:29.774135 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:00:45.758988 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:45.758930 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-65f4f4dcbb-bvvc4" podUID="bbeb6d46-5571-45e0-857e-21e6224c014e" containerName="console" containerID="cri-o://c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d" gracePeriod=15 Oct 30 13:00:45.995298 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:45.995270 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 13:00:46.024617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024559 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024593 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl\" (UniqueName: \"kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024611 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024644 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024725 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024767 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024802 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.024853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.024836 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config\") pod \"bbeb6d46-5571-45e0-857e-21e6224c014e\" (UID: \"bbeb6d46-5571-45e0-857e-21e6224c014e\") " Oct 30 13:00:46.025100 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.025076 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:00:46.025156 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.025082 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:00:46.025156 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.025114 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:00:46.025301 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.025182 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:00:46.025301 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.025253 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:00:46.027032 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.027005 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:00:46.027032 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.027020 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "kube-api-access-2p8rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:00:46.027137 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.027041 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert" pod "bbeb6d46-5571-45e0-857e-21e6224c014e" (UID: "bbeb6d46-5571-45e0-857e-21e6224c014e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:00:46.125368 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125339 4498 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-oauth-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125368 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125364 4498 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-console-config\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125368 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125373 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2p8rl\" (UniqueName: \"kubernetes.io/projected/bbeb6d46-5571-45e0-857e-21e6224c014e-kube-api-access-2p8rl\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125383 4498 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-trusted-ca-bundle\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125391 4498 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-oauth-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125399 4498 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bbeb6d46-5571-45e0-857e-21e6224c014e-console-serving-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125407 4498 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bbeb6d46-5571-45e0-857e-21e6224c014e-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.125574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.125416 4498 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbeb6d46-5571-45e0-857e-21e6224c014e-tmp\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:00:46.723175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.723095 4498 generic.go:356] "Generic (PLEG): container finished" podID="bbeb6d46-5571-45e0-857e-21e6224c014e" containerID="c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d" exitCode=0 Oct 30 13:00:46.723175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.723139 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4f4dcbb-bvvc4" event={"ID":"bbeb6d46-5571-45e0-857e-21e6224c014e","Type":"ContainerDied","Data":"c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d"} Oct 30 13:00:46.723175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.723146 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65f4f4dcbb-bvvc4" Oct 30 13:00:46.723175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.723176 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65f4f4dcbb-bvvc4" event={"ID":"bbeb6d46-5571-45e0-857e-21e6224c014e","Type":"ContainerDied","Data":"44ab12a557b1f2898b6d175989ff5f06c9e0b460d6a321b4e45ee01e04e5b97d"} Oct 30 13:00:46.723504 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.723208 4498 scope.go:122] "RemoveContainer" containerID="c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d" Oct 30 13:00:46.731577 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.731562 4498 scope.go:122] "RemoveContainer" containerID="c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d" Oct 30 13:00:46.731834 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:00:46.731819 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d\": container with ID starting with c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d not found: ID does not exist" containerID="c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d" Oct 30 13:00:46.731884 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.731842 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d"} err="failed to get container status \"c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d\": rpc error: code = NotFound desc = could not find container \"c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d\": container with ID starting with c67b00ec7be5fea1b5211599049a80528c867c1f5f7a797e27b14b8b9b63031d not found: ID does not exist" Oct 30 13:00:46.768878 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.768855 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65f4f4dcbb-bvvc4"] Oct 30 13:00:46.779431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.779402 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65f4f4dcbb-bvvc4"] Oct 30 13:00:46.901448 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:00:46.901408 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbeb6d46-5571-45e0-857e-21e6224c014e" path="/var/lib/kubelet/pods/bbeb6d46-5571-45e0-857e-21e6224c014e/volumes" Oct 30 13:00:59.774271 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:00:59.774238 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:01:29.774278 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:01:29.774240 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:01:59.774438 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:01:59.774401 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:02:04.902267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:04.902220 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:02:04.903043 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:04.903024 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:02:26.834692 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.834618 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb"] Oct 30 13:02:26.835034 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.834853 4498 cpu_manager.go:414] "containerMap: removing container" podUID="bbeb6d46-5571-45e0-857e-21e6224c014e" containerName="console" Oct 30 13:02:26.835034 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.834863 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbeb6d46-5571-45e0-857e-21e6224c014e" containerName="console" Oct 30 13:02:26.835034 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.834917 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbeb6d46-5571-45e0-857e-21e6224c014e" containerName="console" Oct 30 13:02:26.837694 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.837679 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:26.869853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.869822 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Oct 30 13:02:26.869853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.869848 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Oct 30 13:02:26.870057 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.869907 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zmtp6\"" Oct 30 13:02:26.876239 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.876189 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb"] Oct 30 13:02:26.920828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.920802 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cce9a05-cadc-4040-8921-7b1ccd944d6d-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-mjsmb\" (UID: \"7cce9a05-cadc-4040-8921-7b1ccd944d6d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:26.920975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:26.920836 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwd5g\" (UniqueName: \"kubernetes.io/projected/7cce9a05-cadc-4040-8921-7b1ccd944d6d-kube-api-access-hwd5g\") pod \"cert-manager-webhook-5dbbbf75cc-mjsmb\" (UID: \"7cce9a05-cadc-4040-8921-7b1ccd944d6d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:27.021408 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.021381 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwd5g\" (UniqueName: \"kubernetes.io/projected/7cce9a05-cadc-4040-8921-7b1ccd944d6d-kube-api-access-hwd5g\") pod \"cert-manager-webhook-5dbbbf75cc-mjsmb\" (UID: \"7cce9a05-cadc-4040-8921-7b1ccd944d6d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:27.021556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.021440 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cce9a05-cadc-4040-8921-7b1ccd944d6d-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-mjsmb\" (UID: \"7cce9a05-cadc-4040-8921-7b1ccd944d6d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:27.048471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.048433 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7cce9a05-cadc-4040-8921-7b1ccd944d6d-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-mjsmb\" (UID: \"7cce9a05-cadc-4040-8921-7b1ccd944d6d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:27.048855 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.048840 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwd5g\" (UniqueName: \"kubernetes.io/projected/7cce9a05-cadc-4040-8921-7b1ccd944d6d-kube-api-access-hwd5g\") pod \"cert-manager-webhook-5dbbbf75cc-mjsmb\" (UID: \"7cce9a05-cadc-4040-8921-7b1ccd944d6d\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:27.162748 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.162670 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:27.462228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.462187 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb"] Oct 30 13:02:27.464107 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:02:27.464082 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cce9a05_cadc_4040_8921_7b1ccd944d6d.slice/crio-e21ee05d4ca85e5650a7387348b1e5fe7b03bb8f7b373a482a9f0cd7f9786679 WatchSource:0}: Error finding container e21ee05d4ca85e5650a7387348b1e5fe7b03bb8f7b373a482a9f0cd7f9786679: Status 404 returned error can't find the container with id e21ee05d4ca85e5650a7387348b1e5fe7b03bb8f7b373a482a9f0cd7f9786679 Oct 30 13:02:27.466027 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:27.466011 4498 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 13:02:28.034745 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:28.034700 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" event={"ID":"7cce9a05-cadc-4040-8921-7b1ccd944d6d","Type":"ContainerStarted","Data":"e21ee05d4ca85e5650a7387348b1e5fe7b03bb8f7b373a482a9f0cd7f9786679"} Oct 30 13:02:29.778585 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:02:29.778552 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:02:31.045965 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:31.045934 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" event={"ID":"7cce9a05-cadc-4040-8921-7b1ccd944d6d","Type":"ContainerStarted","Data":"33c1eb02baae91e15dccdba29fd78eb1736b98d7e80aa46dea9c1047af1c44c9"} Oct 30 13:02:31.046401 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:31.046027 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:31.084606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:31.084558 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" podStartSLOduration=2.026642923 podStartE2EDuration="5.084546176s" totalImagesPullingTime="3.057903253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:02:31.08412553 +0000 UTC m=+326.314408675" watchObservedRunningTime="2026-10-30 13:02:31.084546176 +0000 UTC m=+326.314829311" Oct 30 13:02:37.051913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:37.051885 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-mjsmb" Oct 30 13:02:48.191425 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.191386 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr"] Oct 30 13:02:48.194409 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.194394 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.215544 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.215522 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-tljtx\"" Oct 30 13:02:48.226187 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.226152 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Oct 30 13:02:48.226331 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.226191 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Oct 30 13:02:48.227022 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.226997 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr"] Oct 30 13:02:48.280997 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.280966 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aefda3d-d30a-449d-bd5b-d6013219f9ad-tmp\") pod \"openshift-lws-operator-8465994787-7qcwr\" (UID: \"1aefda3d-d30a-449d-bd5b-d6013219f9ad\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.281122 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.281005 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj2c9\" (UniqueName: \"kubernetes.io/projected/1aefda3d-d30a-449d-bd5b-d6013219f9ad-kube-api-access-bj2c9\") pod \"openshift-lws-operator-8465994787-7qcwr\" (UID: \"1aefda3d-d30a-449d-bd5b-d6013219f9ad\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.381597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.381566 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aefda3d-d30a-449d-bd5b-d6013219f9ad-tmp\") pod \"openshift-lws-operator-8465994787-7qcwr\" (UID: \"1aefda3d-d30a-449d-bd5b-d6013219f9ad\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.381746 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.381604 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj2c9\" (UniqueName: \"kubernetes.io/projected/1aefda3d-d30a-449d-bd5b-d6013219f9ad-kube-api-access-bj2c9\") pod \"openshift-lws-operator-8465994787-7qcwr\" (UID: \"1aefda3d-d30a-449d-bd5b-d6013219f9ad\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.382047 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.382028 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1aefda3d-d30a-449d-bd5b-d6013219f9ad-tmp\") pod \"openshift-lws-operator-8465994787-7qcwr\" (UID: \"1aefda3d-d30a-449d-bd5b-d6013219f9ad\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.404252 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.404225 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj2c9\" (UniqueName: \"kubernetes.io/projected/1aefda3d-d30a-449d-bd5b-d6013219f9ad-kube-api-access-bj2c9\") pod \"openshift-lws-operator-8465994787-7qcwr\" (UID: \"1aefda3d-d30a-449d-bd5b-d6013219f9ad\") " pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.504795 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.504726 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" Oct 30 13:02:48.803553 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:48.802232 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr"] Oct 30 13:02:48.805930 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:02:48.805900 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1aefda3d_d30a_449d_bd5b_d6013219f9ad.slice/crio-9520cf034ac005324d50be8de753fbb39c553ec2ffc542ca9cb39b141d2c3e8c WatchSource:0}: Error finding container 9520cf034ac005324d50be8de753fbb39c553ec2ffc542ca9cb39b141d2c3e8c: Status 404 returned error can't find the container with id 9520cf034ac005324d50be8de753fbb39c553ec2ffc542ca9cb39b141d2c3e8c Oct 30 13:02:49.108393 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:49.108315 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" event={"ID":"1aefda3d-d30a-449d-bd5b-d6013219f9ad","Type":"ContainerStarted","Data":"9520cf034ac005324d50be8de753fbb39c553ec2ffc542ca9cb39b141d2c3e8c"} Oct 30 13:02:51.117519 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:51.117487 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" event={"ID":"1aefda3d-d30a-449d-bd5b-d6013219f9ad","Type":"ContainerStarted","Data":"0d639a0553ca9a18b08c282ed2847231ea74215307bf7587005eeaa8646f1f6f"} Oct 30 13:02:51.158332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:02:51.158273 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-8465994787-7qcwr" podStartSLOduration=0.953571664 podStartE2EDuration="3.158256572s" totalImagesPullingTime="2.204684908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:02:51.156669433 +0000 UTC m=+346.386952568" watchObservedRunningTime="2026-10-30 13:02:51.158256572 +0000 UTC m=+346.388539708" Oct 30 13:02:59.774555 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:02:59.774516 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:03:05.278754 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.278716 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69565795b9-d9thm"] Oct 30 13:03:05.282971 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.282955 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.300809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.300782 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Oct 30 13:03:05.311426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.311405 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Oct 30 13:03:05.311541 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.311439 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Oct 30 13:03:05.311541 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.311474 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kwrjb\"" Oct 30 13:03:05.319383 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.319361 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69565795b9-d9thm"] Oct 30 13:03:05.423473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.423447 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5aac6f5a-ad04-4b53-a721-339131d09caa-metrics-cert\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.423627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.423493 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fwp4\" (UniqueName: \"kubernetes.io/projected/5aac6f5a-ad04-4b53-a721-339131d09caa-kube-api-access-4fwp4\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.423627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.423515 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5aac6f5a-ad04-4b53-a721-339131d09caa-manager-config\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.423627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.423576 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5aac6f5a-ad04-4b53-a721-339131d09caa-cert\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.524263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.524218 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5aac6f5a-ad04-4b53-a721-339131d09caa-metrics-cert\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.524402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.524311 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fwp4\" (UniqueName: \"kubernetes.io/projected/5aac6f5a-ad04-4b53-a721-339131d09caa-kube-api-access-4fwp4\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.524402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.524349 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5aac6f5a-ad04-4b53-a721-339131d09caa-manager-config\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.524402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.524370 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5aac6f5a-ad04-4b53-a721-339131d09caa-cert\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.525020 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.524973 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5aac6f5a-ad04-4b53-a721-339131d09caa-manager-config\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.526838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.526819 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5aac6f5a-ad04-4b53-a721-339131d09caa-cert\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.526984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.526964 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5aac6f5a-ad04-4b53-a721-339131d09caa-metrics-cert\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.546308 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.546259 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fwp4\" (UniqueName: \"kubernetes.io/projected/5aac6f5a-ad04-4b53-a721-339131d09caa-kube-api-access-4fwp4\") pod \"lws-controller-manager-69565795b9-d9thm\" (UID: \"5aac6f5a-ad04-4b53-a721-339131d09caa\") " pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.592543 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.592523 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:05.958540 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:05.958488 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69565795b9-d9thm"] Oct 30 13:03:05.960486 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:03:05.960465 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aac6f5a_ad04_4b53_a721_339131d09caa.slice/crio-f2506be85c495a07ef10b2249293d4942dffa2fb9a9baf936bc544f3da755a8b WatchSource:0}: Error finding container f2506be85c495a07ef10b2249293d4942dffa2fb9a9baf936bc544f3da755a8b: Status 404 returned error can't find the container with id f2506be85c495a07ef10b2249293d4942dffa2fb9a9baf936bc544f3da755a8b Oct 30 13:03:06.164080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:06.164047 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" event={"ID":"5aac6f5a-ad04-4b53-a721-339131d09caa","Type":"ContainerStarted","Data":"f2506be85c495a07ef10b2249293d4942dffa2fb9a9baf936bc544f3da755a8b"} Oct 30 13:03:08.173420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:08.173388 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" event={"ID":"5aac6f5a-ad04-4b53-a721-339131d09caa","Type":"ContainerStarted","Data":"4724eb311bc99c81dfe5b6c47b66f4afd1710e2c192125e008824cd9be6b87fe"} Oct 30 13:03:08.173820 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:08.173494 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:08.217095 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:08.217041 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" podStartSLOduration=1.759321539 podStartE2EDuration="3.217021322s" totalImagesPullingTime="1.457699783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:03:08.215876781 +0000 UTC m=+363.446159919" watchObservedRunningTime="2026-10-30 13:03:08.217021322 +0000 UTC m=+363.447304457" Oct 30 13:03:19.179465 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:19.179431 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69565795b9-d9thm" Oct 30 13:03:28.464160 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.464130 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz"] Oct 30 13:03:28.472664 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.472643 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.513004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.512974 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz"] Oct 30 13:03:28.552297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.552261 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tp27k\"" Oct 30 13:03:28.552297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.552291 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Oct 30 13:03:28.552490 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.552296 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-metrics-tls\"" Oct 30 13:03:28.552490 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.552304 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Oct 30 13:03:28.552490 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.552308 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Oct 30 13:03:28.552897 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.552883 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Oct 30 13:03:28.594291 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.594259 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aee0a704-54d8-46c7-b650-f65f85722ed1-manifests\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.594448 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.594309 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.594448 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.594428 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee0a704-54d8-46c7-b650-f65f85722ed1-tmp\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.594525 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.594481 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.594525 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.594515 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-metrics-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.594612 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.594539 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkh4j\" (UniqueName: \"kubernetes.io/projected/aee0a704-54d8-46c7-b650-f65f85722ed1-kube-api-access-lkh4j\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695356 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695319 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aee0a704-54d8-46c7-b650-f65f85722ed1-manifests\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695379 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695411 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee0a704-54d8-46c7-b650-f65f85722ed1-tmp\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695435 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695775 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695565 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-metrics-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695775 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695609 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkh4j\" (UniqueName: \"kubernetes.io/projected/aee0a704-54d8-46c7-b650-f65f85722ed1-kube-api-access-lkh4j\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.695887 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.695758 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/aee0a704-54d8-46c7-b650-f65f85722ed1-manifests\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.697842 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.697816 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aee0a704-54d8-46c7-b650-f65f85722ed1-tmp\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.698087 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.698066 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.698173 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.698155 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-webhook-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.698250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.698158 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aee0a704-54d8-46c7-b650-f65f85722ed1-metrics-cert\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.720809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.720751 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkh4j\" (UniqueName: \"kubernetes.io/projected/aee0a704-54d8-46c7-b650-f65f85722ed1-kube-api-access-lkh4j\") pod \"opendatahub-operator-controller-manager-64d4d4766b-2zvqz\" (UID: \"aee0a704-54d8-46c7-b650-f65f85722ed1\") " pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:28.788672 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:28.788644 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:29.271429 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:29.271407 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz"] Oct 30 13:03:29.273444 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:03:29.273414 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee0a704_54d8_46c7_b650_f65f85722ed1.slice/crio-ed151c0d261aae81ee526e85ac098c7246ad127aacd5e35e7600cc19007bbc01 WatchSource:0}: Error finding container ed151c0d261aae81ee526e85ac098c7246ad127aacd5e35e7600cc19007bbc01: Status 404 returned error can't find the container with id ed151c0d261aae81ee526e85ac098c7246ad127aacd5e35e7600cc19007bbc01 Oct 30 13:03:29.779458 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:03:29.779414 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:03:30.250055 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:30.250013 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" event={"ID":"aee0a704-54d8-46c7-b650-f65f85722ed1","Type":"ContainerStarted","Data":"ed151c0d261aae81ee526e85ac098c7246ad127aacd5e35e7600cc19007bbc01"} Oct 30 13:03:32.259471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:32.259429 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" event={"ID":"aee0a704-54d8-46c7-b650-f65f85722ed1","Type":"ContainerStarted","Data":"c76b73c5b89aad993a1c0ebd7194bc76ffa70bd08b9947d7a75a6a66f8d44f9e"} Oct 30 13:03:33.264538 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:33.264504 4498 generic.go:356] "Generic (PLEG): container finished" podID="aee0a704-54d8-46c7-b650-f65f85722ed1" containerID="c76b73c5b89aad993a1c0ebd7194bc76ffa70bd08b9947d7a75a6a66f8d44f9e" exitCode=0 Oct 30 13:03:33.264924 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:33.264569 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" event={"ID":"aee0a704-54d8-46c7-b650-f65f85722ed1","Type":"ContainerDied","Data":"c76b73c5b89aad993a1c0ebd7194bc76ffa70bd08b9947d7a75a6a66f8d44f9e"} Oct 30 13:03:34.271897 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:34.271862 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" event={"ID":"aee0a704-54d8-46c7-b650-f65f85722ed1","Type":"ContainerStarted","Data":"66825ba5cebd9e0e27100c60dab7a1aa40aabc1de286a922d6eefb5475d190ed"} Oct 30 13:03:34.272401 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:34.271989 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:34.355734 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:34.355649 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" podStartSLOduration=2.705239688 podStartE2EDuration="6.355593421s" totalImagesPullingTime="3.184704091s" totalInitContainerRuntime="465.649642ms" isStatefulPod=false podCreationTimestamp="2026-10-30 13:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:03:34.344380045 +0000 UTC m=+389.574663191" watchObservedRunningTime="2026-10-30 13:03:34.355593421 +0000 UTC m=+389.585876962" Oct 30 13:03:45.278405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:03:45.278369 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64d4d4766b-2zvqz" Oct 30 13:03:59.775701 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:03:59.775656 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:04:06.498940 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.498909 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848"] Oct 30 13:04:06.505049 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.505029 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.533186 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.533164 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848"] Oct 30 13:04:06.542492 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.542466 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Oct 30 13:04:06.542648 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.542475 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Oct 30 13:04:06.542648 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.542478 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Oct 30 13:04:06.542821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.542551 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5v2wz\"" Oct 30 13:04:06.581340 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581312 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581470 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581351 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdrvq\" (UniqueName: \"kubernetes.io/projected/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-kube-api-access-jdrvq\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581470 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581387 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581548 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581524 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581547 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581568 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581683 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581591 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581693 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.581739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.581727 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682655 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682625 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682655 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682654 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682675 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682723 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682741 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682760 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682793 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682815 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdrvq\" (UniqueName: \"kubernetes.io/projected/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-kube-api-access-jdrvq\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.682886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.682862 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.683246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.683108 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.683294 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.683265 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.683365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.683350 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.683405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.683382 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.683772 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.683756 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.685286 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.685265 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.685396 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.685380 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.709163 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.709137 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdrvq\" (UniqueName: \"kubernetes.io/projected/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-kube-api-access-jdrvq\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.710330 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.710308 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51eb5efa-7194-41c4-a4ed-ef9963a9d5b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-98f7774f-74848\" (UID: \"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:06.817283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:06.817179 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:07.140048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:07.139972 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848"] Oct 30 13:04:07.142666 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:04:07.142641 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51eb5efa_7194_41c4_a4ed_ef9963a9d5b0.slice/crio-e64635f2078938c37f2a7e6f4ef3959786e2f685e82005bddcf70f2ba5e1b799 WatchSource:0}: Error finding container e64635f2078938c37f2a7e6f4ef3959786e2f685e82005bddcf70f2ba5e1b799: Status 404 returned error can't find the container with id e64635f2078938c37f2a7e6f4ef3959786e2f685e82005bddcf70f2ba5e1b799 Oct 30 13:04:07.395573 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:07.395496 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" event={"ID":"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0","Type":"ContainerStarted","Data":"e64635f2078938c37f2a7e6f4ef3959786e2f685e82005bddcf70f2ba5e1b799"} Oct 30 13:04:09.747381 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:09.747352 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:04:09.747630 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:09.747415 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:04:09.747630 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:09.747442 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:04:10.409180 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:10.409145 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" event={"ID":"51eb5efa-7194-41c4-a4ed-ef9963a9d5b0","Type":"ContainerStarted","Data":"089a4fa6b545436f5cc1de3abfdbc70a83f8e9511b9475da8944201dccf8cda8"} Oct 30 13:04:10.472018 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:10.471971 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" podStartSLOduration=1.870040009 podStartE2EDuration="4.471956985s" totalImagesPullingTime="2.601916976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:04:10.46989108 +0000 UTC m=+425.700174214" watchObservedRunningTime="2026-10-30 13:04:10.471956985 +0000 UTC m=+425.702240119" Oct 30 13:04:10.817516 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:10.817479 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:10.821983 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:10.821957 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:11.413315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:11.413288 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:11.414253 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:04:11.414234 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-98f7774f-74848" Oct 30 13:04:29.776987 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:04:29.776946 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:04:59.774302 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:04:59.774263 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:05:04.870308 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.870271 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-jndx8"] Oct 30 13:05:04.873377 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.873362 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:04.914571 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.914546 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Oct 30 13:05:04.914748 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.914605 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-bzgls\"" Oct 30 13:05:04.914933 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.914915 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-jndx8"] Oct 30 13:05:04.944429 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.944403 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm"] Oct 30 13:05:04.947433 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.947417 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:04.952617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.952587 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pvtv\" (UniqueName: \"kubernetes.io/projected/07880807-333e-468c-82a0-3847f2062b8d-kube-api-access-6pvtv\") pod \"kserve-controller-manager-776cc66d47-jndx8\" (UID: \"07880807-333e-468c-82a0-3847f2062b8d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:04.952736 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.952639 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07880807-333e-468c-82a0-3847f2062b8d-cert\") pod \"kserve-controller-manager-776cc66d47-jndx8\" (UID: \"07880807-333e-468c-82a0-3847f2062b8d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:04.983456 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:04.983434 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm"] Oct 30 13:05:05.023904 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.023868 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Oct 30 13:05:05.023904 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.023902 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nqdmc\"" Oct 30 13:05:05.048658 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.048622 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-pd49g"] Oct 30 13:05:05.052155 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.052124 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.053778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.053761 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ccqq\" (UniqueName: \"kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq\") pod \"llmisvc-controller-manager-869d5dcc5d-79xpm\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.053876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.053793 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pvtv\" (UniqueName: \"kubernetes.io/projected/07880807-333e-468c-82a0-3847f2062b8d-kube-api-access-6pvtv\") pod \"kserve-controller-manager-776cc66d47-jndx8\" (UID: \"07880807-333e-468c-82a0-3847f2062b8d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:05.053876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.053816 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07880807-333e-468c-82a0-3847f2062b8d-cert\") pod \"kserve-controller-manager-776cc66d47-jndx8\" (UID: \"07880807-333e-468c-82a0-3847f2062b8d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:05.053974 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.053880 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-79xpm\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.056525 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.056507 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07880807-333e-468c-82a0-3847f2062b8d-cert\") pod \"kserve-controller-manager-776cc66d47-jndx8\" (UID: \"07880807-333e-468c-82a0-3847f2062b8d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:05.083419 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.083390 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-pd49g"] Oct 30 13:05:05.106579 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.106551 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Oct 30 13:05:05.106782 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.106606 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-s6t29\"" Oct 30 13:05:05.108831 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.108804 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pvtv\" (UniqueName: \"kubernetes.io/projected/07880807-333e-468c-82a0-3847f2062b8d-kube-api-access-6pvtv\") pod \"kserve-controller-manager-776cc66d47-jndx8\" (UID: \"07880807-333e-468c-82a0-3847f2062b8d\") " pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:05.155006 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.154930 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-79xpm\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.155006 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.154986 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qxm8\" (UniqueName: \"kubernetes.io/projected/cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11-kube-api-access-7qxm8\") pod \"model-serving-api-75bd89fdfc-pd49g\" (UID: \"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11\") " pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.155006 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.155007 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11-tls-certs\") pod \"model-serving-api-75bd89fdfc-pd49g\" (UID: \"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11\") " pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.155287 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.155125 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ccqq\" (UniqueName: \"kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq\") pod \"llmisvc-controller-manager-869d5dcc5d-79xpm\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.157586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.157560 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-79xpm\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.177464 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.177438 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ccqq\" (UniqueName: \"kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq\") pod \"llmisvc-controller-manager-869d5dcc5d-79xpm\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.185294 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.185266 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:05.255786 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.255759 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qxm8\" (UniqueName: \"kubernetes.io/projected/cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11-kube-api-access-7qxm8\") pod \"model-serving-api-75bd89fdfc-pd49g\" (UID: \"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11\") " pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.255921 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.255792 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11-tls-certs\") pod \"model-serving-api-75bd89fdfc-pd49g\" (UID: \"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11\") " pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.258329 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.258312 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11-tls-certs\") pod \"model-serving-api-75bd89fdfc-pd49g\" (UID: \"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11\") " pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.259426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.259404 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:05.278028 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.278003 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qxm8\" (UniqueName: \"kubernetes.io/projected/cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11-kube-api-access-7qxm8\") pod \"model-serving-api-75bd89fdfc-pd49g\" (UID: \"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11\") " pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.372066 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.372037 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:05.523035 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.523003 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-jndx8"] Oct 30 13:05:05.526707 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:05:05.526681 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07880807_333e_468c_82a0_3847f2062b8d.slice/crio-631fa828b51a90723d4a23d8fc05c731a9e2fc0fae28a6470a140df15671e9a1 WatchSource:0}: Error finding container 631fa828b51a90723d4a23d8fc05c731a9e2fc0fae28a6470a140df15671e9a1: Status 404 returned error can't find the container with id 631fa828b51a90723d4a23d8fc05c731a9e2fc0fae28a6470a140df15671e9a1 Oct 30 13:05:05.556601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.556582 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm"] Oct 30 13:05:05.558665 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:05:05.558645 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1458442c_8081_4ea5_8fb4_9371837d7113.slice/crio-7d780b19102dcfaf671cdac7c7947d930a7c3d7be004d9d686cdb76a575f3d1a WatchSource:0}: Error finding container 7d780b19102dcfaf671cdac7c7947d930a7c3d7be004d9d686cdb76a575f3d1a: Status 404 returned error can't find the container with id 7d780b19102dcfaf671cdac7c7947d930a7c3d7be004d9d686cdb76a575f3d1a Oct 30 13:05:05.606543 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.606509 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" event={"ID":"1458442c-8081-4ea5-8fb4-9371837d7113","Type":"ContainerStarted","Data":"7d780b19102dcfaf671cdac7c7947d930a7c3d7be004d9d686cdb76a575f3d1a"} Oct 30 13:05:05.607618 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.607598 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" event={"ID":"07880807-333e-468c-82a0-3847f2062b8d","Type":"ContainerStarted","Data":"631fa828b51a90723d4a23d8fc05c731a9e2fc0fae28a6470a140df15671e9a1"} Oct 30 13:05:05.667547 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:05.667523 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-pd49g"] Oct 30 13:05:05.669988 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:05:05.669962 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6d6f45_30ae_43c5_b8b7_2f2ac01a7a11.slice/crio-e5bedd66380d038d18b96a5c3dfe1885ccebff51c373c3390a0ca0f7d2b512ec WatchSource:0}: Error finding container e5bedd66380d038d18b96a5c3dfe1885ccebff51c373c3390a0ca0f7d2b512ec: Status 404 returned error can't find the container with id e5bedd66380d038d18b96a5c3dfe1885ccebff51c373c3390a0ca0f7d2b512ec Oct 30 13:05:06.620235 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:06.620177 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" event={"ID":"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11","Type":"ContainerStarted","Data":"e5bedd66380d038d18b96a5c3dfe1885ccebff51c373c3390a0ca0f7d2b512ec"} Oct 30 13:05:08.636070 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:08.636032 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" event={"ID":"cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11","Type":"ContainerStarted","Data":"fe559980dca289aec3529963e2cb81fe0b9461aacf3e0eb701f62790b1e84bfb"} Oct 30 13:05:08.636882 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:08.636860 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:09.642109 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.642073 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" event={"ID":"07880807-333e-468c-82a0-3847f2062b8d","Type":"ContainerStarted","Data":"308976d1eea1d032c0548a00cef24986c4db35b71e24c5f73659ed998f2efa36"} Oct 30 13:05:09.642567 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.642144 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:09.643530 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.643507 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" event={"ID":"1458442c-8081-4ea5-8fb4-9371837d7113","Type":"ContainerStarted","Data":"20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8"} Oct 30 13:05:09.643697 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.643684 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:09.680968 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.680919 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" podStartSLOduration=2.222760527 podStartE2EDuration="4.680905372s" totalImagesPullingTime="2.458144845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:05:08.680177405 +0000 UTC m=+483.910460546" watchObservedRunningTime="2026-10-30 13:05:09.680905372 +0000 UTC m=+484.911188507" Oct 30 13:05:09.681148 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.681127 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" podStartSLOduration=2.159832016 podStartE2EDuration="5.681122436s" totalImagesPullingTime="3.52129042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:05:09.680518449 +0000 UTC m=+484.910801581" watchObservedRunningTime="2026-10-30 13:05:09.681122436 +0000 UTC m=+484.911405571" Oct 30 13:05:09.721666 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:09.721566 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" podStartSLOduration=2.310115503 podStartE2EDuration="5.721551093s" totalImagesPullingTime="3.41143559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:05:09.71961983 +0000 UTC m=+484.949902964" watchObservedRunningTime="2026-10-30 13:05:09.721551093 +0000 UTC m=+484.951834229" Oct 30 13:05:20.651510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:20.651428 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-pd49g" Oct 30 13:05:29.774159 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:05:29.774124 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:05:40.649999 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:40.649965 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:05:40.653099 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:05:40.653078 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-jndx8" Oct 30 13:05:59.776851 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:05:59.776816 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:06:29.774089 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:06:29.774044 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:06:59.775039 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:06:59.774994 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:07:04.923002 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:04.922975 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:07:04.925127 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:04.925101 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:07:17.807287 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.807254 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7"] Oct 30 13:07:17.810572 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.810548 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:17.839318 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.839296 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7"] Oct 30 13:07:17.853369 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.853344 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 13:07:17.853501 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.853488 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 13:07:17.853557 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.853545 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6szdh\"" Oct 30 13:07:17.936222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.936168 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgrsh\" (UniqueName: \"kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh\") pod \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:17.936361 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:17.936337 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:18.037572 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:18.037540 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:18.037742 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:18.037587 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgrsh\" (UniqueName: \"kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh\") pod \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:18.037938 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:18.037909 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:18.061747 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:18.061690 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgrsh\" (UniqueName: \"kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh\") pod \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:18.122865 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:18.122834 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:18.461703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:18.461682 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7"] Oct 30 13:07:18.464687 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:07:18.464663 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5695493_c4ad_4632_a3da_57f6fb29e1e8.slice/crio-2211af5e1bcc8f61e7d097f073be7bb33cbeb253d8c2a6776473b5b34c13773e WatchSource:0}: Error finding container 2211af5e1bcc8f61e7d097f073be7bb33cbeb253d8c2a6776473b5b34c13773e: Status 404 returned error can't find the container with id 2211af5e1bcc8f61e7d097f073be7bb33cbeb253d8c2a6776473b5b34c13773e Oct 30 13:07:19.137275 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:19.137236 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" event={"ID":"c5695493-c4ad-4632-a3da-57f6fb29e1e8","Type":"ContainerStarted","Data":"2211af5e1bcc8f61e7d097f073be7bb33cbeb253d8c2a6776473b5b34c13773e"} Oct 30 13:07:23.156027 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:23.155991 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" event={"ID":"c5695493-c4ad-4632-a3da-57f6fb29e1e8","Type":"ContainerStarted","Data":"492fcb9e7a6d13037df3035efe835e4f4085e49b401b872bd08d6dd65058a28c"} Oct 30 13:07:23.156474 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:23.156124 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:23.226224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:23.226148 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" podStartSLOduration=2.598126602 podStartE2EDuration="6.226136715s" totalImagesPullingTime="3.628010113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:07:23.225959043 +0000 UTC m=+618.456242178" watchObservedRunningTime="2026-10-30 13:07:23.226136715 +0000 UTC m=+618.456419849" Oct 30 13:07:29.777946 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:29.777911 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:07:34.161513 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:34.161487 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:36.942508 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:36.942470 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b"] Oct 30 13:07:36.945930 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:36.945912 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:36.996523 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:36.996482 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b"] Oct 30 13:07:37.109296 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.109260 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqtjf\" (UniqueName: \"kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf\") pod \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.109468 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.109317 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.210731 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.210646 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.210881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.210739 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqtjf\" (UniqueName: \"kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf\") pod \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.211138 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.211113 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.234414 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.234387 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqtjf\" (UniqueName: \"kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf\") pod \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.258304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.258267 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:37.588901 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:37.588820 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b"] Oct 30 13:07:37.603257 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:07:37.603224 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a54b24_cbee_496d_bcb6_87f2715bb1bc.slice/crio-3f90fd2188a8d3c9267af2565804fc87d882e1861f867c0948d1eab1e0cdad8a WatchSource:0}: Error finding container 3f90fd2188a8d3c9267af2565804fc87d882e1861f867c0948d1eab1e0cdad8a: Status 404 returned error can't find the container with id 3f90fd2188a8d3c9267af2565804fc87d882e1861f867c0948d1eab1e0cdad8a Oct 30 13:07:38.052635 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.052600 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7"] Oct 30 13:07:38.053028 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.052801 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" containerName="manager" containerID="cri-o://492fcb9e7a6d13037df3035efe835e4f4085e49b401b872bd08d6dd65058a28c" gracePeriod=2 Oct 30 13:07:38.063803 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.063060 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7"] Oct 30 13:07:38.065506 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.065476 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:38.090230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.090177 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b"] Oct 30 13:07:38.101423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.101391 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b"] Oct 30 13:07:38.103087 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103066 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q"] Oct 30 13:07:38.103546 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103512 4498 cpu_manager.go:414] "containerMap: removing container" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" containerName="manager" Oct 30 13:07:38.103546 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103532 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" containerName="manager" Oct 30 13:07:38.103703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103564 4498 cpu_manager.go:414] "containerMap: removing container" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" containerName="manager" Oct 30 13:07:38.103703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103571 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" containerName="manager" Oct 30 13:07:38.103703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103660 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" containerName="manager" Oct 30 13:07:38.103703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.103672 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" containerName="manager" Oct 30 13:07:38.106781 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.106759 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.120571 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.120545 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt"] Oct 30 13:07:38.121793 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.121765 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:38.123796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.123780 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.137259 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.137232 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q"] Oct 30 13:07:38.150308 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.150277 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt"] Oct 30 13:07:38.177065 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.177020 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:38.219826 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.219793 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-lhk8q\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.220004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.219856 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhktv\" (UniqueName: \"kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv\") pod \"kuadrant-operator-controller-manager-6b6fb56846-lhk8q\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.220004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.219884 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-z96tt\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.220004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.219935 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85kmn\" (UniqueName: \"kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn\") pod \"kuadrant-operator-controller-manager-858bb878d8-z96tt\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.229279 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.229242 4498 generic.go:356] "Generic (PLEG): container finished" podID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" containerID="492fcb9e7a6d13037df3035efe835e4f4085e49b401b872bd08d6dd65058a28c" exitCode=0 Oct 30 13:07:38.245842 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.245617 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:38.259644 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.259599 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:38.309770 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.309710 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:38.320950 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.320923 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhktv\" (UniqueName: \"kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv\") pod \"kuadrant-operator-controller-manager-6b6fb56846-lhk8q\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.321071 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.320957 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-z96tt\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.321111 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.321084 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85kmn\" (UniqueName: \"kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn\") pod \"kuadrant-operator-controller-manager-858bb878d8-z96tt\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.321162 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.321150 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-lhk8q\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.321324 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.321307 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-858bb878d8-z96tt\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.321481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.321466 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6b6fb56846-lhk8q\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.321772 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.321741 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:38.342389 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:38.342344 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6b6fb56846-697n7\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:38.355126 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.355102 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85kmn\" (UniqueName: \"kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn\") pod \"kuadrant-operator-controller-manager-858bb878d8-z96tt\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.355283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.355105 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhktv\" (UniqueName: \"kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv\") pod \"kuadrant-operator-controller-manager-6b6fb56846-lhk8q\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.422159 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.422126 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh\" (UniqueName: \"kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh\") pod \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " Oct 30 13:07:38.422344 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.422171 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume\") pod \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\" (UID: \"c5695493-c4ad-4632-a3da-57f6fb29e1e8\") " Oct 30 13:07:38.422722 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.422695 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume" pod "c5695493-c4ad-4632-a3da-57f6fb29e1e8" (UID: "c5695493-c4ad-4632-a3da-57f6fb29e1e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:07:38.424505 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.424485 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh" pod "c5695493-c4ad-4632-a3da-57f6fb29e1e8" (UID: "c5695493-c4ad-4632-a3da-57f6fb29e1e8"). InnerVolumeSpecName "kube-api-access-vgrsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:07:38.442840 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.442811 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:38.448169 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.448152 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:38.522768 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.522745 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgrsh\" (UniqueName: \"kubernetes.io/projected/c5695493-c4ad-4632-a3da-57f6fb29e1e8-kube-api-access-vgrsh\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:07:38.522768 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.522768 4498 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c5695493-c4ad-4632-a3da-57f6fb29e1e8-extensions-socket-volume\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:07:38.776949 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.776923 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q"] Oct 30 13:07:38.778435 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.778414 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt"] Oct 30 13:07:38.779722 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:07:38.779699 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfc53aa_2fa7_418c_8d31_a47be0109dc1.slice/crio-2c23a4f1768175106ba70f1e0f372ba92a5f8412a221aaac1bc20852f06ab87c WatchSource:0}: Error finding container 2c23a4f1768175106ba70f1e0f372ba92a5f8412a221aaac1bc20852f06ab87c: Status 404 returned error can't find the container with id 2c23a4f1768175106ba70f1e0f372ba92a5f8412a221aaac1bc20852f06ab87c Oct 30 13:07:38.780330 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:07:38.780309 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657ae25c_e97e_4310_b5cd_98f2b38cdbae.slice/crio-256ba2e680c24df25213c4dc9fd2eed1ed77cba69fd94d8df45df405c1f620ef WatchSource:0}: Error finding container 256ba2e680c24df25213c4dc9fd2eed1ed77cba69fd94d8df45df405c1f620ef: Status 404 returned error can't find the container with id 256ba2e680c24df25213c4dc9fd2eed1ed77cba69fd94d8df45df405c1f620ef Oct 30 13:07:38.899528 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:38.899495 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5695493-c4ad-4632-a3da-57f6fb29e1e8" path="/var/lib/kubelet/pods/c5695493-c4ad-4632-a3da-57f6fb29e1e8/volumes" Oct 30 13:07:39.242461 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.242423 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" event={"ID":"657ae25c-e97e-4310-b5cd-98f2b38cdbae","Type":"ContainerStarted","Data":"8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7"} Oct 30 13:07:39.242915 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.242586 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:39.242915 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.242665 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" event={"ID":"657ae25c-e97e-4310-b5cd-98f2b38cdbae","Type":"ContainerStarted","Data":"256ba2e680c24df25213c4dc9fd2eed1ed77cba69fd94d8df45df405c1f620ef"} Oct 30 13:07:39.243998 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.243978 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-697n7" Oct 30 13:07:39.244116 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.244008 4498 scope.go:122] "RemoveContainer" containerID="492fcb9e7a6d13037df3035efe835e4f4085e49b401b872bd08d6dd65058a28c" Oct 30 13:07:39.245904 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.245878 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" event={"ID":"2dfc53aa-2fa7-418c-8d31-a47be0109dc1","Type":"ContainerStarted","Data":"2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a"} Oct 30 13:07:39.245989 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.245924 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" event={"ID":"2dfc53aa-2fa7-418c-8d31-a47be0109dc1","Type":"ContainerStarted","Data":"2c23a4f1768175106ba70f1e0f372ba92a5f8412a221aaac1bc20852f06ab87c"} Oct 30 13:07:39.246298 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.246127 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:39.246451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.245959 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" containerName="manager" containerID="cri-o://f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9" gracePeriod=2 Oct 30 13:07:39.291407 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.291355 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" podStartSLOduration=1.2913383010000001 podStartE2EDuration="1.291338301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:07:39.290602439 +0000 UTC m=+634.520885575" watchObservedRunningTime="2026-10-30 13:07:39.291338301 +0000 UTC m=+634.521621436" Oct 30 13:07:39.339841 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.339786 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" podStartSLOduration=1.3397691680000001 podStartE2EDuration="1.339769168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:07:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:07:39.338657987 +0000 UTC m=+634.568941122" watchObservedRunningTime="2026-10-30 13:07:39.339769168 +0000 UTC m=+634.570052302" Oct 30 13:07:39.492626 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.492566 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:39.504367 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:39.504318 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:39.632130 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.632094 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume\") pod \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " Oct 30 13:07:39.632332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.632235 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf\" (UniqueName: \"kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf\") pod \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\" (UID: \"93a54b24-cbee-496d-bcb6-87f2715bb1bc\") " Oct 30 13:07:39.632809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.632757 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume" pod "93a54b24-cbee-496d-bcb6-87f2715bb1bc" (UID: "93a54b24-cbee-496d-bcb6-87f2715bb1bc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:07:39.635434 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.635402 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf" pod "93a54b24-cbee-496d-bcb6-87f2715bb1bc" (UID: "93a54b24-cbee-496d-bcb6-87f2715bb1bc"). InnerVolumeSpecName "kube-api-access-pqtjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:07:39.733046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.732976 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqtjf\" (UniqueName: \"kubernetes.io/projected/93a54b24-cbee-496d-bcb6-87f2715bb1bc-kube-api-access-pqtjf\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:07:39.733046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:39.733014 4498 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93a54b24-cbee-496d-bcb6-87f2715bb1bc-extensions-socket-volume\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:07:40.251038 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:40.250998 4498 generic.go:356] "Generic (PLEG): container finished" podID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" containerID="f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9" exitCode=0 Oct 30 13:07:40.251501 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:40.251043 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:40.251501 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:40.251089 4498 scope.go:122] "RemoveContainer" containerID="f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9" Oct 30 13:07:40.259461 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:40.259444 4498 scope.go:122] "RemoveContainer" containerID="f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9" Oct 30 13:07:40.259720 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:40.259702 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9\": container with ID starting with f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9 not found: ID does not exist" containerID="f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9" Oct 30 13:07:40.259775 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:40.259729 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9"} err="failed to get container status \"f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9\": rpc error: code = NotFound desc = could not find container \"f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9\": container with ID starting with f048dda3211e04c5978170d1fa7a8ae8c2042afea80d3feb38adbcf6a8274ee9 not found: ID does not exist" Oct 30 13:07:40.263031 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:40.263006 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:40.278267 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:40.278242 4498 status_manager.go:1045] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-858bb878d8-pjp5b\" is forbidden: User \"system:node:ip-10-0-130-34.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-34.ec2.internal' and this object" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-pjp5b" Oct 30 13:07:40.899419 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:40.899385 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="93a54b24-cbee-496d-bcb6-87f2715bb1bc" path="/var/lib/kubelet/pods/93a54b24-cbee-496d-bcb6-87f2715bb1bc/volumes" Oct 30 13:07:50.254893 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.254859 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:07:50.255296 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.254925 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:50.377409 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.377375 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q"] Oct 30 13:07:50.377565 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.377550 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" podUID="657ae25c-e97e-4310-b5cd-98f2b38cdbae" containerName="manager" containerID="cri-o://8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7" gracePeriod=10 Oct 30 13:07:50.631211 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.631181 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:50.720122 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.720091 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv\" (UniqueName: \"kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv\") pod \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " Oct 30 13:07:50.722358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.722325 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv" pod "657ae25c-e97e-4310-b5cd-98f2b38cdbae" (UID: "657ae25c-e97e-4310-b5cd-98f2b38cdbae"). InnerVolumeSpecName "kube-api-access-mhktv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:07:50.820617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.820518 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume\") pod \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\" (UID: \"657ae25c-e97e-4310-b5cd-98f2b38cdbae\") " Oct 30 13:07:50.820976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.820947 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume" pod "657ae25c-e97e-4310-b5cd-98f2b38cdbae" (UID: "657ae25c-e97e-4310-b5cd-98f2b38cdbae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:07:50.821108 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.821090 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhktv\" (UniqueName: \"kubernetes.io/projected/657ae25c-e97e-4310-b5cd-98f2b38cdbae-kube-api-access-mhktv\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:07:50.821178 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.821112 4498 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/657ae25c-e97e-4310-b5cd-98f2b38cdbae-extensions-socket-volume\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:07:50.822437 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.822413 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q"] Oct 30 13:07:50.822737 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.822725 4498 cpu_manager.go:414] "containerMap: removing container" podUID="657ae25c-e97e-4310-b5cd-98f2b38cdbae" containerName="manager" Oct 30 13:07:50.822778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.822740 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="657ae25c-e97e-4310-b5cd-98f2b38cdbae" containerName="manager" Oct 30 13:07:50.822825 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.822816 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="657ae25c-e97e-4310-b5cd-98f2b38cdbae" containerName="manager" Oct 30 13:07:50.825788 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.825773 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:50.863090 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.863066 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q"] Oct 30 13:07:50.921539 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.921508 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pm8\" (UniqueName: \"kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8\") pod \"kuadrant-operator-controller-manager-57bb9bfff-kdc8q\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:50.921677 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:50.921554 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-kdc8q\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:51.022647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.022617 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pm8\" (UniqueName: \"kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8\") pod \"kuadrant-operator-controller-manager-57bb9bfff-kdc8q\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:51.022789 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.022678 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-kdc8q\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:51.023053 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.023033 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-kdc8q\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:51.060302 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.060280 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pm8\" (UniqueName: \"kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8\") pod \"kuadrant-operator-controller-manager-57bb9bfff-kdc8q\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:51.145330 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.145253 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:51.299606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.299574 4498 generic.go:356] "Generic (PLEG): container finished" podID="657ae25c-e97e-4310-b5cd-98f2b38cdbae" containerID="8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7" exitCode=0 Oct 30 13:07:51.300083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.299619 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" Oct 30 13:07:51.300083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.299661 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" event={"ID":"657ae25c-e97e-4310-b5cd-98f2b38cdbae","Type":"ContainerDied","Data":"8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7"} Oct 30 13:07:51.300083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.299718 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q" event={"ID":"657ae25c-e97e-4310-b5cd-98f2b38cdbae","Type":"ContainerDied","Data":"256ba2e680c24df25213c4dc9fd2eed1ed77cba69fd94d8df45df405c1f620ef"} Oct 30 13:07:51.300083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.299749 4498 scope.go:122] "RemoveContainer" containerID="8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7" Oct 30 13:07:51.307990 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.307975 4498 scope.go:122] "RemoveContainer" containerID="8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7" Oct 30 13:07:51.308273 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:51.308255 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7\": container with ID starting with 8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7 not found: ID does not exist" containerID="8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7" Oct 30 13:07:51.308320 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.308283 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7"} err="failed to get container status \"8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7\": rpc error: code = NotFound desc = could not find container \"8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7\": container with ID starting with 8f1944f36ab6f217329ef664019e0144bbfab9b381cce14e74b77db3a94b1ea7 not found: ID does not exist" Oct 30 13:07:51.356170 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.356146 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q"] Oct 30 13:07:51.369635 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.369615 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6b6fb56846-lhk8q"] Oct 30 13:07:51.453773 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:51.453740 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q"] Oct 30 13:07:51.456915 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:07:51.456890 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3253b26b_8188_414a_adeb_5a560011ffc0.slice/crio-c979eb4d61729ae98a31c09f71fd1a2d3536f0869ba1b19dcac2d2eb552da162 WatchSource:0}: Error finding container c979eb4d61729ae98a31c09f71fd1a2d3536f0869ba1b19dcac2d2eb552da162: Status 404 returned error can't find the container with id c979eb4d61729ae98a31c09f71fd1a2d3536f0869ba1b19dcac2d2eb552da162 Oct 30 13:07:52.307080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:52.307050 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" event={"ID":"3253b26b-8188-414a-adeb-5a560011ffc0","Type":"ContainerStarted","Data":"f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a"} Oct 30 13:07:52.307503 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:52.307098 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" event={"ID":"3253b26b-8188-414a-adeb-5a560011ffc0","Type":"ContainerStarted","Data":"c979eb4d61729ae98a31c09f71fd1a2d3536f0869ba1b19dcac2d2eb552da162"} Oct 30 13:07:52.307503 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:52.307170 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:07:52.368984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:52.368931 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" podStartSLOduration=2.3689006040000002 podStartE2EDuration="2.368900604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:07:52.367942283 +0000 UTC m=+647.598225419" watchObservedRunningTime="2026-10-30 13:07:52.368900604 +0000 UTC m=+647.599183741" Oct 30 13:07:52.898851 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:07:52.898821 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="657ae25c-e97e-4310-b5cd-98f2b38cdbae" path="/var/lib/kubelet/pods/657ae25c-e97e-4310-b5cd-98f2b38cdbae/volumes" Oct 30 13:07:59.774604 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:07:59.774568 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:08:03.313892 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.313858 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:08:03.424828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.424798 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt"] Oct 30 13:08:03.425052 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.425028 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" podUID="2dfc53aa-2fa7-418c-8d31-a47be0109dc1" containerName="manager" containerID="cri-o://2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a" gracePeriod=10 Oct 30 13:08:03.670818 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.670795 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:08:03.713354 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.713324 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn\" (UniqueName: \"kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn\") pod \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " Oct 30 13:08:03.713505 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.713408 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume\") pod \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\" (UID: \"2dfc53aa-2fa7-418c-8d31-a47be0109dc1\") " Oct 30 13:08:03.713754 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.713733 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume" pod "2dfc53aa-2fa7-418c-8d31-a47be0109dc1" (UID: "2dfc53aa-2fa7-418c-8d31-a47be0109dc1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:08:03.715518 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.715498 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn" pod "2dfc53aa-2fa7-418c-8d31-a47be0109dc1" (UID: "2dfc53aa-2fa7-418c-8d31-a47be0109dc1"). InnerVolumeSpecName "kube-api-access-85kmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:08:03.814819 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.814778 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85kmn\" (UniqueName: \"kubernetes.io/projected/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-kube-api-access-85kmn\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:08:03.814819 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:03.814816 4498 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dfc53aa-2fa7-418c-8d31-a47be0109dc1-extensions-socket-volume\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:08:04.357558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.357518 4498 generic.go:356] "Generic (PLEG): container finished" podID="2dfc53aa-2fa7-418c-8d31-a47be0109dc1" containerID="2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a" exitCode=0 Oct 30 13:08:04.357981 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.357570 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" Oct 30 13:08:04.357981 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.357598 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" event={"ID":"2dfc53aa-2fa7-418c-8d31-a47be0109dc1","Type":"ContainerDied","Data":"2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a"} Oct 30 13:08:04.357981 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.357654 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt" event={"ID":"2dfc53aa-2fa7-418c-8d31-a47be0109dc1","Type":"ContainerDied","Data":"2c23a4f1768175106ba70f1e0f372ba92a5f8412a221aaac1bc20852f06ab87c"} Oct 30 13:08:04.357981 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.357676 4498 scope.go:122] "RemoveContainer" containerID="2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a" Oct 30 13:08:04.366558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.366542 4498 scope.go:122] "RemoveContainer" containerID="2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a" Oct 30 13:08:04.366811 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:08:04.366791 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a\": container with ID starting with 2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a not found: ID does not exist" containerID="2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a" Oct 30 13:08:04.366871 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.366824 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a"} err="failed to get container status \"2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a\": rpc error: code = NotFound desc = could not find container \"2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a\": container with ID starting with 2a154829fa342f110da3272323fc8deb1f867d0f0d181158b7e9489cb934369a not found: ID does not exist" Oct 30 13:08:04.414081 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.414058 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt"] Oct 30 13:08:04.424509 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.424483 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-858bb878d8-z96tt"] Oct 30 13:08:04.899298 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:04.899269 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2dfc53aa-2fa7-418c-8d31-a47be0109dc1" path="/var/lib/kubelet/pods/2dfc53aa-2fa7-418c-8d31-a47be0109dc1/volumes" Oct 30 13:08:17.700604 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.700525 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck"] Oct 30 13:08:17.701027 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.700941 4498 cpu_manager.go:414] "containerMap: removing container" podUID="2dfc53aa-2fa7-418c-8d31-a47be0109dc1" containerName="manager" Oct 30 13:08:17.701027 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.700959 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2dfc53aa-2fa7-418c-8d31-a47be0109dc1" containerName="manager" Oct 30 13:08:17.701113 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.701065 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="2dfc53aa-2fa7-418c-8d31-a47be0109dc1" containerName="manager" Oct 30 13:08:17.705381 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.705359 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.722657 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.722640 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5td7d\"" Oct 30 13:08:17.734446 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.734422 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck"] Oct 30 13:08:17.817488 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817443 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817488 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817488 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817516 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817638 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817677 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817703 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6rw\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817932 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817784 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817932 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817816 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.817932 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.817845 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.918789 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.918753 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.918789 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.918792 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919185 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.918813 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919185 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.918844 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919185 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.918874 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919236 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919289 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919304 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919389 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919407 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6rw\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919654 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919590 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919690 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919648 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919690 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919656 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.919807 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.919791 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.921916 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.921893 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.922086 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.922070 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.941178 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.941154 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:17.941487 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:17.941470 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6rw\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-wntck\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:18.017745 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.017667 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:18.328857 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.328835 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck"] Oct 30 13:08:18.331337 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:08:18.331312 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5b3e5d_ae64_4bdb_b068_69f937f5bd00.slice/crio-0fa37965ab2c1907a4e1d8663ee143dd839132d969962576fa7aec4ea358a688 WatchSource:0}: Error finding container 0fa37965ab2c1907a4e1d8663ee143dd839132d969962576fa7aec4ea358a688: Status 404 returned error can't find the container with id 0fa37965ab2c1907a4e1d8663ee143dd839132d969962576fa7aec4ea358a688 Oct 30 13:08:18.333244 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.333211 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:08:18.333329 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.333281 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:08:18.333329 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.333313 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:08:18.417134 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.417097 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" event={"ID":"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00","Type":"ContainerStarted","Data":"e7b8df9b598383e7658891a7412e937a62bafec97f6a21f35da466ad3ea4567d"} Oct 30 13:08:18.417345 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.417159 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" event={"ID":"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00","Type":"ContainerStarted","Data":"0fa37965ab2c1907a4e1d8663ee143dd839132d969962576fa7aec4ea358a688"} Oct 30 13:08:18.459690 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:18.459638 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podStartSLOduration=1.45962198 podStartE2EDuration="1.45962198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:08:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:08:18.458163864 +0000 UTC m=+673.688446998" watchObservedRunningTime="2026-10-30 13:08:18.45962198 +0000 UTC m=+673.689905116" Oct 30 13:08:19.018258 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:19.018218 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:19.023444 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:19.023421 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:19.420945 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:19.420867 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:19.421725 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:08:19.421709 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:08:29.774222 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:08:29.774168 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:08:59.774648 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:08:59.774606 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:09:29.774650 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:09:29.774612 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:09:52.461772 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.461693 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-c78xj"] Oct 30 13:09:52.464798 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.464781 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.488371 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.488347 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 13:09:52.488544 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.488352 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5qrbm\"" Oct 30 13:09:52.488662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.488384 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 13:09:52.488662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.488528 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Oct 30 13:09:52.488799 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.488642 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Oct 30 13:09:52.489873 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.489855 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-c78xj"] Oct 30 13:09:52.552306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.552270 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.552306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.552310 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52mb7\" (UniqueName: \"kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.552526 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.552391 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.552526 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.552458 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.653116 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.653076 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.653116 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.653114 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52mb7\" (UniqueName: \"kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.653415 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.653139 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.653415 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.653158 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.653806 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.653783 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.655774 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.655756 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.655919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.655896 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.681596 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.681572 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52mb7\" (UniqueName: \"kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7\") pod \"maas-api-5c48877c75-c78xj\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:52.776807 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:52.776723 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:53.073721 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:53.073700 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-c78xj"] Oct 30 13:09:53.076155 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:09:53.076128 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc443a009_a2bf_477a_af1e_22603bb78851.slice/crio-b62f2439e8c40bbe04c2a5f742d798774b4e4baa8bbcb3d17ba9c83dd03fa40e WatchSource:0}: Error finding container b62f2439e8c40bbe04c2a5f742d798774b4e4baa8bbcb3d17ba9c83dd03fa40e: Status 404 returned error can't find the container with id b62f2439e8c40bbe04c2a5f742d798774b4e4baa8bbcb3d17ba9c83dd03fa40e Oct 30 13:09:53.077375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:53.077357 4498 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 13:09:53.804851 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:53.804814 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" event={"ID":"c443a009-a2bf-477a-af1e-22603bb78851","Type":"ContainerStarted","Data":"b62f2439e8c40bbe04c2a5f742d798774b4e4baa8bbcb3d17ba9c83dd03fa40e"} Oct 30 13:09:55.816688 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:55.816649 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" event={"ID":"c443a009-a2bf-477a-af1e-22603bb78851","Type":"ContainerStarted","Data":"4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765"} Oct 30 13:09:55.817080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:55.816796 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:09:55.858717 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:09:55.858592 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" podStartSLOduration=1.336545449 podStartE2EDuration="3.858574767s" totalImagesPullingTime="2.522029318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:09:55.857744333 +0000 UTC m=+771.088027468" watchObservedRunningTime="2026-10-30 13:09:55.858574767 +0000 UTC m=+771.088857904" Oct 30 13:09:59.780501 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:09:59.780460 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:10:01.826848 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:01.826818 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:10:03.190587 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.190553 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-hggtx"] Oct 30 13:10:03.196190 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.196172 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.214029 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.213998 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-hggtx"] Oct 30 13:10:03.248801 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.248771 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e05590f-1fb3-4b1e-915a-fa6be34519cf-cert\") pod \"llmisvc-controller-manager-6466c554d8-hggtx\" (UID: \"2e05590f-1fb3-4b1e-915a-fa6be34519cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.248936 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.248815 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25gwh\" (UniqueName: \"kubernetes.io/projected/2e05590f-1fb3-4b1e-915a-fa6be34519cf-kube-api-access-25gwh\") pod \"llmisvc-controller-manager-6466c554d8-hggtx\" (UID: \"2e05590f-1fb3-4b1e-915a-fa6be34519cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.349906 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.349879 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25gwh\" (UniqueName: \"kubernetes.io/projected/2e05590f-1fb3-4b1e-915a-fa6be34519cf-kube-api-access-25gwh\") pod \"llmisvc-controller-manager-6466c554d8-hggtx\" (UID: \"2e05590f-1fb3-4b1e-915a-fa6be34519cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.350057 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.349977 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e05590f-1fb3-4b1e-915a-fa6be34519cf-cert\") pod \"llmisvc-controller-manager-6466c554d8-hggtx\" (UID: \"2e05590f-1fb3-4b1e-915a-fa6be34519cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.352655 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.352634 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e05590f-1fb3-4b1e-915a-fa6be34519cf-cert\") pod \"llmisvc-controller-manager-6466c554d8-hggtx\" (UID: \"2e05590f-1fb3-4b1e-915a-fa6be34519cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.372032 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.372010 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25gwh\" (UniqueName: \"kubernetes.io/projected/2e05590f-1fb3-4b1e-915a-fa6be34519cf-kube-api-access-25gwh\") pod \"llmisvc-controller-manager-6466c554d8-hggtx\" (UID: \"2e05590f-1fb3-4b1e-915a-fa6be34519cf\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.510598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.510501 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:03.804348 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.804323 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-hggtx"] Oct 30 13:10:03.806795 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:10:03.806773 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e05590f_1fb3_4b1e_915a_fa6be34519cf.slice/crio-3127ecec367681010ccb3002db671a1c7972daaf07908574c821aa07bd4b6957 WatchSource:0}: Error finding container 3127ecec367681010ccb3002db671a1c7972daaf07908574c821aa07bd4b6957: Status 404 returned error can't find the container with id 3127ecec367681010ccb3002db671a1c7972daaf07908574c821aa07bd4b6957 Oct 30 13:10:03.884871 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.884839 4498 generic.go:356] "Generic (PLEG): container finished" podID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerID="e7b8df9b598383e7658891a7412e937a62bafec97f6a21f35da466ad3ea4567d" exitCode=0 Oct 30 13:10:03.885030 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.884870 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" event={"ID":"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00","Type":"ContainerDied","Data":"e7b8df9b598383e7658891a7412e937a62bafec97f6a21f35da466ad3ea4567d"} Oct 30 13:10:03.885304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.885280 4498 scope.go:122] "RemoveContainer" containerID="e7b8df9b598383e7658891a7412e937a62bafec97f6a21f35da466ad3ea4567d" Oct 30 13:10:03.886192 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.886175 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" event={"ID":"2e05590f-1fb3-4b1e-915a-fa6be34519cf","Type":"ContainerStarted","Data":"3127ecec367681010ccb3002db671a1c7972daaf07908574c821aa07bd4b6957"} Oct 30 13:10:03.886445 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.886422 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:10:03.886496 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.886483 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:10:03.886534 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:03.886515 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:10:04.421507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:04.421421 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:10:04.891378 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:04.891348 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" event={"ID":"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00","Type":"ContainerStarted","Data":"33f296d103afae97e70ec9480cce337c6ed0c3a7925f610efcb8205af35b4416"} Oct 30 13:10:04.892697 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:04.892675 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" event={"ID":"2e05590f-1fb3-4b1e-915a-fa6be34519cf","Type":"ContainerStarted","Data":"2db3c320a7c8ee38b2fdf4380ba1e67bd2a037baab47ffb8bea773b7b3285804"} Oct 30 13:10:04.892808 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:04.892723 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:04.990997 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:04.990949 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" podStartSLOduration=1.668919178 podStartE2EDuration="1.990937241s" totalImagesPullingTime="322.018063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:10:04.990484935 +0000 UTC m=+780.220768069" watchObservedRunningTime="2026-10-30 13:10:04.990937241 +0000 UTC m=+780.221220418" Oct 30 13:10:05.018649 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:05.018616 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:10:05.019546 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:05.019523 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 30 13:10:05.019599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:05.019573 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 30 13:10:06.018972 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:06.018939 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 30 13:10:06.019471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:06.018996 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 30 13:10:07.018449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:07.018413 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 30 13:10:07.018655 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:07.018482 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 30 13:10:08.018720 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:08.018682 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 30 13:10:08.019118 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:08.018735 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 30 13:10:09.018168 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:09.018131 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Oct 30 13:10:09.018379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:09.018217 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Oct 30 13:10:10.022621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:10.022591 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:10:10.022992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:10.022874 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:10:10.023613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:10.023597 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:10:29.775097 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:10:29.775063 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:10:35.899057 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:35.899024 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-hggtx" Oct 30 13:10:35.979838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:35.979806 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm"] Oct 30 13:10:35.980090 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:35.980043 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" podUID="1458442c-8081-4ea5-8fb4-9371837d7113" containerName="manager" containerID="cri-o://20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8" gracePeriod=30 Oct 30 13:10:36.227613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.227591 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:10:36.337250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.337218 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert\" (UniqueName: \"kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert\") pod \"1458442c-8081-4ea5-8fb4-9371837d7113\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " Oct 30 13:10:36.337411 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.337312 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq\" (UniqueName: \"kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq\") pod \"1458442c-8081-4ea5-8fb4-9371837d7113\" (UID: \"1458442c-8081-4ea5-8fb4-9371837d7113\") " Oct 30 13:10:36.339554 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.339529 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq" pod "1458442c-8081-4ea5-8fb4-9371837d7113" (UID: "1458442c-8081-4ea5-8fb4-9371837d7113"). InnerVolumeSpecName "kube-api-access-2ccqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:10:36.339554 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.339540 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert" pod "1458442c-8081-4ea5-8fb4-9371837d7113" (UID: "1458442c-8081-4ea5-8fb4-9371837d7113"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:10:36.438059 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.438025 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ccqq\" (UniqueName: \"kubernetes.io/projected/1458442c-8081-4ea5-8fb4-9371837d7113-kube-api-access-2ccqq\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:10:36.438059 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:36.438054 4498 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1458442c-8081-4ea5-8fb4-9371837d7113-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:10:37.022081 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.022054 4498 generic.go:356] "Generic (PLEG): container finished" podID="1458442c-8081-4ea5-8fb4-9371837d7113" containerID="20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8" exitCode=0 Oct 30 13:10:37.022522 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.022104 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" Oct 30 13:10:37.022522 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.022146 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" event={"ID":"1458442c-8081-4ea5-8fb4-9371837d7113","Type":"ContainerDied","Data":"20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8"} Oct 30 13:10:37.022522 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.022219 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm" event={"ID":"1458442c-8081-4ea5-8fb4-9371837d7113","Type":"ContainerDied","Data":"7d780b19102dcfaf671cdac7c7947d930a7c3d7be004d9d686cdb76a575f3d1a"} Oct 30 13:10:37.022522 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.022243 4498 scope.go:122] "RemoveContainer" containerID="20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8" Oct 30 13:10:37.030226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.030191 4498 scope.go:122] "RemoveContainer" containerID="20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8" Oct 30 13:10:37.030502 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:10:37.030484 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8\": container with ID starting with 20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8 not found: ID does not exist" containerID="20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8" Oct 30 13:10:37.030587 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.030508 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8"} err="failed to get container status \"20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8\": rpc error: code = NotFound desc = could not find container \"20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8\": container with ID starting with 20974a9ff2b1718689876f7778f1039ded14720b0e6c7adf0123e842501c70f8 not found: ID does not exist" Oct 30 13:10:37.076708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.076679 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm"] Oct 30 13:10:37.086991 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:37.086959 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-79xpm"] Oct 30 13:10:38.899396 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:10:38.899366 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1458442c-8081-4ea5-8fb4-9371837d7113" path="/var/lib/kubelet/pods/1458442c-8081-4ea5-8fb4-9371837d7113/volumes" Oct 30 13:10:59.776541 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:10:59.776496 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:11:29.778322 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:11:29.778238 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:11:33.789112 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.789072 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp"] Oct 30 13:11:33.789527 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.789494 4498 cpu_manager.go:414] "containerMap: removing container" podUID="1458442c-8081-4ea5-8fb4-9371837d7113" containerName="manager" Oct 30 13:11:33.789527 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.789507 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1458442c-8081-4ea5-8fb4-9371837d7113" containerName="manager" Oct 30 13:11:33.789596 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.789572 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="1458442c-8081-4ea5-8fb4-9371837d7113" containerName="manager" Oct 30 13:11:33.792442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.792420 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.826836 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.826796 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp"] Oct 30 13:11:33.845495 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845455 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845678 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845590 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845678 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845642 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845678 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845673 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845822 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845699 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845822 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845750 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845903 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845833 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.845903 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845864 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kbpd\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.846008 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.845978 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947215 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947170 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947233 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947251 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947268 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947283 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947305 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947334 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kbpd\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947412 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947791 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947443 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947791 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947671 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947905 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947808 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.947962 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.947897 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.948032 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.948012 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.948221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.948184 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.950240 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.950216 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.950433 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.950415 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.969031 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.969006 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:33.969134 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:33.969078 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kbpd\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-92wlp\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:34.105230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:34.105118 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:34.419042 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:34.418963 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp"] Oct 30 13:11:34.423626 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:11:34.423599 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f28a91_b3fe_4fbb_ae03_651541d3510a.slice/crio-6b64445ef86c7100b40ffdcd55e4f32bb24b37828c4209c25bc4449bef73f046 WatchSource:0}: Error finding container 6b64445ef86c7100b40ffdcd55e4f32bb24b37828c4209c25bc4449bef73f046: Status 404 returned error can't find the container with id 6b64445ef86c7100b40ffdcd55e4f32bb24b37828c4209c25bc4449bef73f046 Oct 30 13:11:34.425926 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:34.425890 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:11:34.426023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:34.425972 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:11:34.426089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:34.426019 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:11:35.292504 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:35.292467 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" event={"ID":"59f28a91-b3fe-4fbb-ae03-651541d3510a","Type":"ContainerStarted","Data":"557cf9f38e249432063321f4a8b021dea946410fcd3493adbf0a385cd1a6d051"} Oct 30 13:11:35.293102 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:35.292560 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" event={"ID":"59f28a91-b3fe-4fbb-ae03-651541d3510a","Type":"ContainerStarted","Data":"6b64445ef86c7100b40ffdcd55e4f32bb24b37828c4209c25bc4449bef73f046"} Oct 30 13:11:35.360230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:35.355288 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podStartSLOduration=2.355268498 podStartE2EDuration="2.355268498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:11:35.353818234 +0000 UTC m=+870.584101370" watchObservedRunningTime="2026-10-30 13:11:35.355268498 +0000 UTC m=+870.585551635" Oct 30 13:11:36.105364 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:36.105332 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:36.106933 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:36.106903 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:11:36.107062 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:36.106948 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:11:37.106260 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:37.106212 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:11:37.106782 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:37.106289 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:11:38.106168 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:38.106127 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:11:38.106416 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:38.106242 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:11:39.106316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:39.106277 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:11:39.106535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:39.106349 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:11:40.106363 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:40.106322 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:11:40.106590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:40.106383 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:11:41.105628 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:41.105586 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:11:41.105835 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:41.105646 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:11:43.107105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:43.107068 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:11:43.107568 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:43.107129 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:11:44.148426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:44.148381 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:11:44.148948 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:44.148460 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:11:44.666663 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:44.666630 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:44.667067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:44.667045 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:44.667917 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:44.667897 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:11:48.851445 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.851413 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t"] Oct 30 13:11:48.854993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.854972 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.910793 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.910765 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t"] Oct 30 13:11:48.976691 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976658 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.976883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976718 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shxr\" (UniqueName: \"kubernetes.io/projected/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-kube-api-access-4shxr\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.976883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976789 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.976883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976860 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.976883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976879 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.977039 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976906 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.977039 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.976929 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.977039 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.977009 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:48.977141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:48.977075 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078314 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078365 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078397 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078445 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078493 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shxr\" (UniqueName: \"kubernetes.io/projected/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-kube-api-access-4shxr\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078522 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078569 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078598 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078885 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078626 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078885 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078812 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-data\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078995 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078927 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-workload-certs\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.078995 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.078983 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-workload-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.079104 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.079060 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-credential-socket\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.079239 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.079187 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.080979 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.080953 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-envoy\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.081615 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.081597 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.114041 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.113981 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-istio-token\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.114238 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.114214 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shxr\" (UniqueName: \"kubernetes.io/projected/eb3a6c12-03bd-4ea8-88ae-95605bda0e31-kube-api-access-4shxr\") pod \"maas-default-gateway-openshift-default-c9ffffc7f-zbh6t\" (UID: \"eb3a6c12-03bd-4ea8-88ae-95605bda0e31\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.168064 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.168032 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:49.482309 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.482285 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t"] Oct 30 13:11:49.484635 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:11:49.484610 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3a6c12_03bd_4ea8_88ae_95605bda0e31.slice/crio-b051291845fdeec8fd3ef28bfa1da5fc7d330ee6510099958bf538d21da53514 WatchSource:0}: Error finding container b051291845fdeec8fd3ef28bfa1da5fc7d330ee6510099958bf538d21da53514: Status 404 returned error can't find the container with id b051291845fdeec8fd3ef28bfa1da5fc7d330ee6510099958bf538d21da53514 Oct 30 13:11:49.486719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.486688 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:11:49.486782 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.486751 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:11:49.486817 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:49.486800 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:11:50.364328 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:50.364291 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" event={"ID":"eb3a6c12-03bd-4ea8-88ae-95605bda0e31","Type":"ContainerStarted","Data":"60419e59e2f246efe8b8160c423cafc24760804c2647273be89dd38d0c550bf0"} Oct 30 13:11:50.364778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:50.364342 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" event={"ID":"eb3a6c12-03bd-4ea8-88ae-95605bda0e31","Type":"ContainerStarted","Data":"b051291845fdeec8fd3ef28bfa1da5fc7d330ee6510099958bf538d21da53514"} Oct 30 13:11:50.426761 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:50.426714 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podStartSLOduration=2.42670083 podStartE2EDuration="2.42670083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:11:50.416359261 +0000 UTC m=+885.646642396" watchObservedRunningTime="2026-10-30 13:11:50.42670083 +0000 UTC m=+885.656983965" Oct 30 13:11:51.168130 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:51.168098 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:51.169639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:51.169612 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 13:11:51.169800 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:51.169658 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podUID="eb3a6c12-03bd-4ea8-88ae-95605bda0e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 13:11:52.168464 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:52.168427 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 13:11:52.168856 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:52.168480 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podUID="eb3a6c12-03bd-4ea8-88ae-95605bda0e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 13:11:53.169048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:53.169010 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 13:11:53.169474 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:53.169070 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podUID="eb3a6c12-03bd-4ea8-88ae-95605bda0e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 13:11:54.169092 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:54.169054 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 13:11:54.169522 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:54.169112 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podUID="eb3a6c12-03bd-4ea8-88ae-95605bda0e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 13:11:55.168410 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:55.168379 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 13:11:55.168600 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:55.168432 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podUID="eb3a6c12-03bd-4ea8-88ae-95605bda0e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 13:11:56.169379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:56.169343 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Oct 30 13:11:56.169790 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:56.169429 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" podUID="eb3a6c12-03bd-4ea8-88ae-95605bda0e31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Oct 30 13:11:57.689627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:57.689596 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:57.696023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:57.690592 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:57.696023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:11:57.691442 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-zbh6t" Oct 30 13:11:59.775240 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:11:59.775177 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:12:04.945911 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:12:04.945886 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:12:04.949737 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:12:04.949714 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:12:29.774190 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:12:29.774150 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:12:59.774963 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:12:59.774928 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:13:14.274310 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.274277 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6"] Oct 30 13:13:14.277659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.277643 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.293262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.293239 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-031737-serving-cert\"" Oct 30 13:13:14.305606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.305579 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6"] Oct 30 13:13:14.414126 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.414097 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.414126 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.414132 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz64m\" (UniqueName: \"kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.414370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.414156 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.414370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.414338 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.515048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.515015 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.515267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.515062 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz64m\" (UniqueName: \"kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.515267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.515105 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.515267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.515168 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.515908 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.515853 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.518061 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.518035 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.518543 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.518517 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.537627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.537548 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz64m\" (UniqueName: \"kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m\") pod \"maas-api-e2e-worker-w0-031737-784b655d79-6mlw6\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.592424 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.592389 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:14.891269 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:14.891246 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6"] Oct 30 13:13:14.893171 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:14.893146 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e5719f_45f9_48af_8606_a8e8cb1b9c02.slice/crio-f8280ca995ff9e195d182bf2ec83ded2f07491db25653ab5918b9048be3ee014 WatchSource:0}: Error finding container f8280ca995ff9e195d182bf2ec83ded2f07491db25653ab5918b9048be3ee014: Status 404 returned error can't find the container with id f8280ca995ff9e195d182bf2ec83ded2f07491db25653ab5918b9048be3ee014 Oct 30 13:13:15.728850 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:15.728817 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" event={"ID":"57e5719f-45f9-48af-8606-a8e8cb1b9c02","Type":"ContainerStarted","Data":"514fb816106c1bc77bc12a4b803d8bcb661aac28e22bb9fccb76a011cda08c27"} Oct 30 13:13:15.729371 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:15.728866 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" event={"ID":"57e5719f-45f9-48af-8606-a8e8cb1b9c02","Type":"ContainerStarted","Data":"f8280ca995ff9e195d182bf2ec83ded2f07491db25653ab5918b9048be3ee014"} Oct 30 13:13:15.729371 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:15.728967 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:15.771813 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:15.771761 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" podStartSLOduration=1.413877054 podStartE2EDuration="1.771742357s" totalImagesPullingTime="357.865303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:15.767170368 +0000 UTC m=+970.997453503" watchObservedRunningTime="2026-10-30 13:13:15.771742357 +0000 UTC m=+971.002025499" Oct 30 13:13:16.413399 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.413366 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh"] Oct 30 13:13:16.416716 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.416700 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.450606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.450581 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-88f6a4-serving-cert\"" Oct 30 13:13:16.467363 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.467336 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh"] Oct 30 13:13:16.531500 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.531470 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.531672 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.531505 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.531672 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.531593 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57f5v\" (UniqueName: \"kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.531787 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.531711 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.632659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.632621 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.632850 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.632681 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.632850 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.632742 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57f5v\" (UniqueName: \"kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.632850 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.632801 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.633027 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:13:16.632932 4498 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-serving-cert: secret "maas-api-e2e-worker-w4-88f6a4-serving-cert" not found Oct 30 13:13:16.633027 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:13:16.632987 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls podName:a5360e13-b776-4843-82f7-4ba122aada7f nodeName:}" failed. No retries permitted until 2026-10-30 13:13:17.132973032 +0000 UTC m=+972.363256145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls") pod "maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" (UID: "a5360e13-b776-4843-82f7-4ba122aada7f") : secret "maas-api-e2e-worker-w4-88f6a4-serving-cert" not found Oct 30 13:13:16.633488 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.633464 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.635659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.635636 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:16.674935 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:16.674863 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57f5v\" (UniqueName: \"kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:17.138706 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:17.138647 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:17.141421 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:17.141388 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:17.329803 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:17.329762 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:17.626628 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:17.626602 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh"] Oct 30 13:13:17.629243 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:17.629213 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5360e13_b776_4843_82f7_4ba122aada7f.slice/crio-699d4d088ac26d48c4d0405a17322a058e4bde4302322de2c019a3152c41e15b WatchSource:0}: Error finding container 699d4d088ac26d48c4d0405a17322a058e4bde4302322de2c019a3152c41e15b: Status 404 returned error can't find the container with id 699d4d088ac26d48c4d0405a17322a058e4bde4302322de2c019a3152c41e15b Oct 30 13:13:17.737909 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:17.737865 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" event={"ID":"a5360e13-b776-4843-82f7-4ba122aada7f","Type":"ContainerStarted","Data":"699d4d088ac26d48c4d0405a17322a058e4bde4302322de2c019a3152c41e15b"} Oct 30 13:13:18.744389 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.744328 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" event={"ID":"a5360e13-b776-4843-82f7-4ba122aada7f","Type":"ContainerStarted","Data":"ced365b1096b7cd863ddd01bfa5b9b0c4d086ee8ae3580f01783c0d97ab719fb"} Oct 30 13:13:18.744979 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.744951 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:18.797716 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.797681 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j"] Oct 30 13:13:18.801113 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.801090 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:18.830870 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.830835 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-d0a18c-serving-cert\"" Oct 30 13:13:18.843285 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.841925 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" podStartSLOduration=2.539133569 podStartE2EDuration="2.841906249s" totalImagesPullingTime="302.77268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:18.826532033 +0000 UTC m=+974.056815168" watchObservedRunningTime="2026-10-30 13:13:18.841906249 +0000 UTC m=+974.072189385" Oct 30 13:13:18.844814 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.844020 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j"] Oct 30 13:13:18.953578 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.953545 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:18.953753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.953593 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvp8l\" (UniqueName: \"kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:18.953753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.953674 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:18.953826 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:18.953777 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.054310 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.054184 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.054310 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.054294 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvp8l\" (UniqueName: \"kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.054608 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.054468 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.054608 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.054562 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.055167 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.055148 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.056942 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.056918 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.057503 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.057482 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.080622 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.080582 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvp8l\" (UniqueName: \"kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l\") pod \"maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.114436 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.114400 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:19.544781 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.544745 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j"] Oct 30 13:13:19.547189 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:19.547159 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738ebca1_c01b_40c9_be8d_110447b9f28a.slice/crio-a4329eae4f8038258ca24c8ca332c3d1b92b4f15c9bf223f7506251f1118ddad WatchSource:0}: Error finding container a4329eae4f8038258ca24c8ca332c3d1b92b4f15c9bf223f7506251f1118ddad: Status 404 returned error can't find the container with id a4329eae4f8038258ca24c8ca332c3d1b92b4f15c9bf223f7506251f1118ddad Oct 30 13:13:19.751151 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:19.751109 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" event={"ID":"738ebca1-c01b-40c9-be8d-110447b9f28a","Type":"ContainerStarted","Data":"a4329eae4f8038258ca24c8ca332c3d1b92b4f15c9bf223f7506251f1118ddad"} Oct 30 13:13:20.757613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:20.757579 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" event={"ID":"738ebca1-c01b-40c9-be8d-110447b9f28a","Type":"ContainerStarted","Data":"955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61"} Oct 30 13:13:20.758081 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:20.757719 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:20.801806 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:20.801754 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" podStartSLOduration=2.392078552 podStartE2EDuration="2.80173961s" totalImagesPullingTime="409.661058ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:20.800570322 +0000 UTC m=+976.030853456" watchObservedRunningTime="2026-10-30 13:13:20.80173961 +0000 UTC m=+976.032022752" Oct 30 13:13:21.673658 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.673628 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk"] Oct 30 13:13:21.676864 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.676849 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.695884 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.695861 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-ab3176-serving-cert\"" Oct 30 13:13:21.708976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.708948 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk"] Oct 30 13:13:21.739983 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.739945 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:13:21.778351 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.778314 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx847\" (UniqueName: \"kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.778753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.778387 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.778753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.778508 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.778753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.778613 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.879997 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.879954 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.880208 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.880049 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx847\" (UniqueName: \"kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.880720 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.880379 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.880720 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:13:21.880451 4498 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-serving-cert: secret "maas-api-e2e-worker-w6-ab3176-serving-cert" not found Oct 30 13:13:21.880720 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.880490 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.880720 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:13:21.880521 4498 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls podName:8959a267-e5fd-4e93-a5cc-a0cd380bbfe0 nodeName:}" failed. No retries permitted until 2026-10-30 13:13:22.380499743 +0000 UTC m=+977.610782877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls") pod "maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" (UID: "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0") : secret "maas-api-e2e-worker-w6-ab3176-serving-cert" not found Oct 30 13:13:21.880989 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.880840 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.883050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.883027 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:21.914599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:21.914560 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx847\" (UniqueName: \"kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:22.386606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:22.386570 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:22.389424 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:22.389394 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\") pod \"maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:22.590058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:22.590014 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:22.904570 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:22.904550 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk"] Oct 30 13:13:22.906862 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:22.906836 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8959a267_e5fd_4e93_a5cc_a0cd380bbfe0.slice/crio-8de20596b717a968b2a62a91a676b85a07ad485a65d1df6ecfee4014e70e4b9b WatchSource:0}: Error finding container 8de20596b717a968b2a62a91a676b85a07ad485a65d1df6ecfee4014e70e4b9b: Status 404 returned error can't find the container with id 8de20596b717a968b2a62a91a676b85a07ad485a65d1df6ecfee4014e70e4b9b Oct 30 13:13:23.772846 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:23.772813 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" event={"ID":"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0","Type":"ContainerStarted","Data":"3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada"} Oct 30 13:13:23.773051 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:23.772866 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" event={"ID":"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0","Type":"ContainerStarted","Data":"8de20596b717a968b2a62a91a676b85a07ad485a65d1df6ecfee4014e70e4b9b"} Oct 30 13:13:23.773051 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:23.772896 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:23.847623 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:23.847568 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" podStartSLOduration=2.533874303 podStartE2EDuration="2.847551126s" totalImagesPullingTime="313.676823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:23.847318426 +0000 UTC m=+979.077601573" watchObservedRunningTime="2026-10-30 13:13:23.847551126 +0000 UTC m=+979.077834262" Oct 30 13:13:24.756835 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:24.756808 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:13:26.768213 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:26.768167 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:13:29.776700 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:13:29.776662 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:13:29.783942 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:29.783920 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:13:33.223816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.223781 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm"] Oct 30 13:13:33.227390 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.227371 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.240066 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.240042 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-f76c09-serving-cert\"" Oct 30 13:13:33.252770 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.252741 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm"] Oct 30 13:13:33.290377 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.290347 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.290556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.290391 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.290601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.290561 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.290649 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.290622 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4zw\" (UniqueName: \"kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.391406 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.391362 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.391597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.391420 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4zw\" (UniqueName: \"kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.391597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.391465 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.391597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.391492 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.391999 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.391977 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.394050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.394024 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.394131 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.394058 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.415543 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.415514 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4zw\" (UniqueName: \"kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw\") pod \"maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.542601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.542496 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:33.852711 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:33.852687 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm"] Oct 30 13:13:33.854766 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:33.854736 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ec3890_f9fc_48d4_802b_3ea67d1a3408.slice/crio-e6e61c08fc5c32516a352afb0da9cbcc6090394dad6d0439e18cc584bff8256e WatchSource:0}: Error finding container e6e61c08fc5c32516a352afb0da9cbcc6090394dad6d0439e18cc584bff8256e: Status 404 returned error can't find the container with id e6e61c08fc5c32516a352afb0da9cbcc6090394dad6d0439e18cc584bff8256e Oct 30 13:13:34.823048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:34.823016 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" event={"ID":"a9ec3890-f9fc-48d4-802b-3ea67d1a3408","Type":"ContainerStarted","Data":"788f69e56d71aedab6296236a235351ff9a2de8d3006d149429fd8c1039e7187"} Oct 30 13:13:34.823479 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:34.823065 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" event={"ID":"a9ec3890-f9fc-48d4-802b-3ea67d1a3408","Type":"ContainerStarted","Data":"e6e61c08fc5c32516a352afb0da9cbcc6090394dad6d0439e18cc584bff8256e"} Oct 30 13:13:34.823479 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:34.823095 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:34.867937 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:34.867882 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" podStartSLOduration=1.493236502 podStartE2EDuration="1.867866541s" totalImagesPullingTime="374.630039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:34.865551597 +0000 UTC m=+990.095834733" watchObservedRunningTime="2026-10-30 13:13:34.867866541 +0000 UTC m=+990.098150072" Oct 30 13:13:36.959715 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.959682 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb"] Oct 30 13:13:36.963058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.963036 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:36.986661 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.986574 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-031737\"/\"default-dockercfg-dxfjj\"" Oct 30 13:13:36.986813 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.986690 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-031737\"/\"simulator-w0-031737-kserve-self-signed-certs\"" Oct 30 13:13:36.987138 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.987116 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-031737\"/\"kube-root-ca.crt\"" Oct 30 13:13:36.987257 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.987163 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-031737\"/\"openshift-service-ca.crt\"" Oct 30 13:13:36.989148 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:36.989128 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb"] Oct 30 13:13:37.024174 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.024137 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.024174 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.024171 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.024423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.024342 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.024423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.024400 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.024558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.024426 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jckx\" (UniqueName: \"kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.024626 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.024558 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.125574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.125540 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.125759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.125609 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.125759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.125641 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.125759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.125660 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jckx\" (UniqueName: \"kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.125759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.125722 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.125973 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.125765 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.126027 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.126009 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.126115 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.126066 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.126312 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.126118 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.128392 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.128362 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.128513 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.128495 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.147171 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.147146 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jckx\" (UniqueName: \"kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx\") pod \"simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.276075 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.275979 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:37.575133 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.575105 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb"] Oct 30 13:13:37.576745 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:37.576719 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ca47bfd_2e2f_405f_8080_b3a18bd7bc57.slice/crio-d6d848e0dd32de1010bcc414002844ba6bd720cd8d9ccd3539618945f556f3a9 WatchSource:0}: Error finding container d6d848e0dd32de1010bcc414002844ba6bd720cd8d9ccd3539618945f556f3a9: Status 404 returned error can't find the container with id d6d848e0dd32de1010bcc414002844ba6bd720cd8d9ccd3539618945f556f3a9 Oct 30 13:13:37.841438 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:37.841329 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" event={"ID":"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57","Type":"ContainerStarted","Data":"d6d848e0dd32de1010bcc414002844ba6bd720cd8d9ccd3539618945f556f3a9"} Oct 30 13:13:39.854162 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:39.854115 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" event={"ID":"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57","Type":"ContainerStarted","Data":"e8f4e10666945d332b4219c400431fd63712450c79266cb1579ac7084d3635cc"} Oct 30 13:13:39.901605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:39.901548 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podStartSLOduration=2.7043494729999997 podStartE2EDuration="3.901529681s" totalImagesPullingTime="1.197180208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:39.900107253 +0000 UTC m=+995.130390389" watchObservedRunningTime="2026-10-30 13:13:39.901529681 +0000 UTC m=+995.131812816" Oct 30 13:13:40.277151 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:40.277111 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:40.833024 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:40.832992 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:13:46.984576 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:46.984537 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk"] Oct 30 13:13:46.988390 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:46.988368 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.012618 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.012581 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-88f6a4\"/\"default-dockercfg-cdfd5\"" Oct 30 13:13:47.012751 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.012637 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-88f6a4\"/\"simulator-w4-88f6a4-kserve-self-signed-certs\"" Oct 30 13:13:47.014023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.014002 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-88f6a4\"/\"openshift-service-ca.crt\"" Oct 30 13:13:47.015315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.015291 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-88f6a4\"/\"kube-root-ca.crt\"" Oct 30 13:13:47.017445 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.017368 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk"] Oct 30 13:13:47.126668 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.126626 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.126869 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.126677 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.126869 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.126705 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.127001 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.126943 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.127001 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.126984 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj68m\" (UniqueName: \"kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.127124 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.127101 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.227650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.227614 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.227848 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.227658 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj68m\" (UniqueName: \"kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.227848 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.227796 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.227970 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.227853 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.227970 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.227879 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.227970 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.227902 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.228177 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.228141 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.228278 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.228254 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.228403 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.228378 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.230419 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.230391 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.230600 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.230584 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.255456 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.255388 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj68m\" (UniqueName: \"kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m\") pod \"simulator-w4-88f6a4-kserve-6488dddf44-qjfnk\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.276996 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.276962 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:47.292881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.292856 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:47.300415 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.300390 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:47.618980 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.618954 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk"] Oct 30 13:13:47.621112 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:47.621089 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ec0beab_649b_4134_a2b5_55b028f40172.slice/crio-ff773a12d57635eccf7126bd0fbf20f47760e2f13bb63628b5ada933422d0b83 WatchSource:0}: Error finding container ff773a12d57635eccf7126bd0fbf20f47760e2f13bb63628b5ada933422d0b83: Status 404 returned error can't find the container with id ff773a12d57635eccf7126bd0fbf20f47760e2f13bb63628b5ada933422d0b83 Oct 30 13:13:47.894569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.894476 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" event={"ID":"3ec0beab-649b-4134-a2b5-55b028f40172","Type":"ContainerStarted","Data":"be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9"} Oct 30 13:13:47.894569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.894522 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" event={"ID":"3ec0beab-649b-4134-a2b5-55b028f40172","Type":"ContainerStarted","Data":"ff773a12d57635eccf7126bd0fbf20f47760e2f13bb63628b5ada933422d0b83"} Oct 30 13:13:47.905721 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.905695 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:13:47.962123 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:47.962075 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podStartSLOduration=1.962061066 podStartE2EDuration="1.962061066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:47.960475758 +0000 UTC m=+1003.190758892" watchObservedRunningTime="2026-10-30 13:13:47.962061066 +0000 UTC m=+1003.192344201" Oct 30 13:13:48.300567 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:48.300532 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:52.406405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.406373 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt"] Oct 30 13:13:52.410023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.410001 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.435053 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.435003 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d0a18c\"/\"default-dockercfg-hwmgv\"" Oct 30 13:13:52.435232 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.435125 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-d0a18c\"/\"openshift-service-ca.crt\"" Oct 30 13:13:52.435232 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.435136 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d0a18c\"/\"simulator-w3-d0a18c-kserve-self-signed-certs\"" Oct 30 13:13:52.435445 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.435429 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-d0a18c\"/\"kube-root-ca.crt\"" Oct 30 13:13:52.448955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.448922 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt"] Oct 30 13:13:52.480926 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.480891 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.481157 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.480957 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf9nf\" (UniqueName: \"kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.481246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.481153 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.481311 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.481246 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.481454 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.481412 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.481697 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.481678 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582383 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582347 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582402 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582443 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582471 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582525 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582569 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf9nf\" (UniqueName: \"kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.582961 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.582927 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.583090 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.583034 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.583184 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.583165 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.586481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.586453 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.587746 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.587720 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.647384 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.647353 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf9nf\" (UniqueName: \"kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf\") pod \"simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:52.722028 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:52.721996 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:53.026823 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:53.026735 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt"] Oct 30 13:13:53.029008 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:13:53.028985 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d3a501f_1d4f_4abb_899f_2db484cb8d69.slice/crio-836991377d386f47efad3859c721be430cf5a7744e6ea89df28a6b443c17e024 WatchSource:0}: Error finding container 836991377d386f47efad3859c721be430cf5a7744e6ea89df28a6b443c17e024: Status 404 returned error can't find the container with id 836991377d386f47efad3859c721be430cf5a7744e6ea89df28a6b443c17e024 Oct 30 13:13:53.927640 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:53.927607 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" event={"ID":"4d3a501f-1d4f-4abb-899f-2db484cb8d69","Type":"ContainerStarted","Data":"cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e"} Oct 30 13:13:53.928117 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:53.927649 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" event={"ID":"4d3a501f-1d4f-4abb-899f-2db484cb8d69","Type":"ContainerStarted","Data":"836991377d386f47efad3859c721be430cf5a7744e6ea89df28a6b443c17e024"} Oct 30 13:13:53.968883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:53.968810 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podStartSLOduration=1.9687955719999999 podStartE2EDuration="1.968795572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:13:53.968584742 +0000 UTC m=+1009.198867877" watchObservedRunningTime="2026-10-30 13:13:53.968795572 +0000 UTC m=+1009.199078707" Oct 30 13:13:54.722629 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:54.722587 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:13:57.301535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:57.301503 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:57.314115 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:57.314090 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:57.963144 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:13:57.963118 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:13:59.778827 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:13:59.778775 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:14:02.722644 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:02.722607 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:14:02.737243 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:02.737214 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:14:02.986932 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:02.986851 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:14:26.845390 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.845300 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg"] Oct 30 13:14:26.849568 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.849540 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:26.874991 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.874959 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-88f6a4\"/\"premium-w4-88f6a4-kserve-self-signed-certs\"" Oct 30 13:14:26.882250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.881829 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg"] Oct 30 13:14:26.923493 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.923465 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:26.923700 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.923568 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:26.923700 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.923594 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7qzp\" (UniqueName: \"kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:26.923700 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.923620 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:26.923700 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.923683 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:26.923935 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:26.923742 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024371 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024340 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024406 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024439 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qzp\" (UniqueName: \"kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024461 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024494 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024527 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024899 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024877 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.024899 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.024893 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.025097 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.025078 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.027036 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.027004 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.027319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.027303 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.056221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.055887 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7qzp\" (UniqueName: \"kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp\") pod \"premium-w4-88f6a4-kserve-85cdf6665c-286dg\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.165398 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.165311 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:27.472991 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:27.472970 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg"] Oct 30 13:14:27.479348 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:14:27.479322 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b5b88be_8533_461c_afae_ba189119a4f7.slice/crio-9c1cc53e74431627e838304203907c58529c19ec0dbddb4606f36db0632ac322 WatchSource:0}: Error finding container 9c1cc53e74431627e838304203907c58529c19ec0dbddb4606f36db0632ac322: Status 404 returned error can't find the container with id 9c1cc53e74431627e838304203907c58529c19ec0dbddb4606f36db0632ac322 Oct 30 13:14:28.097741 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:28.097712 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" event={"ID":"4b5b88be-8533-461c-afae-ba189119a4f7","Type":"ContainerStarted","Data":"04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382"} Oct 30 13:14:28.098111 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:28.097750 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" event={"ID":"4b5b88be-8533-461c-afae-ba189119a4f7","Type":"ContainerStarted","Data":"9c1cc53e74431627e838304203907c58529c19ec0dbddb4606f36db0632ac322"} Oct 30 13:14:28.164108 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:28.164064 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" podStartSLOduration=2.164049791 podStartE2EDuration="2.164049791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:14:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:14:28.162415079 +0000 UTC m=+1043.392698217" watchObservedRunningTime="2026-10-30 13:14:28.164049791 +0000 UTC m=+1043.394332925" Oct 30 13:14:28.165863 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:28.165841 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:29.322193 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.322157 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c"] Oct 30 13:14:29.325922 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.325899 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.355805 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.355778 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-d0a18c\"/\"premium-w3-d0a18c-kserve-self-signed-certs\"" Oct 30 13:14:29.371023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.370996 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c"] Oct 30 13:14:29.448850 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.448805 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxj57\" (UniqueName: \"kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.449026 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.448867 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.449026 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.448991 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.449119 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.449058 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.449225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.449185 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.449317 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.449299 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550233 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxj57\" (UniqueName: \"kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550273 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550545 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550305 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550545 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550364 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550545 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550434 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550545 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550500 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550730 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.550988 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.550962 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.551165 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.551134 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.553386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.553359 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.553511 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.553501 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.571739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.571715 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxj57\" (UniqueName: \"kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57\") pod \"premium-w3-d0a18c-kserve-6cf849d594-7cx7c\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.638168 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.638084 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:29.776260 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:14:29.776176 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:14:29.937561 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:29.937536 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c"] Oct 30 13:14:29.939376 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:14:29.939334 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode21ce9c5_50df_42ce_8777_f956fa7a0b42.slice/crio-9ff5424bfdd0c4358055240f1e9f4e9c40c44e7844be2be9fc284ddd3bc32796 WatchSource:0}: Error finding container 9ff5424bfdd0c4358055240f1e9f4e9c40c44e7844be2be9fc284ddd3bc32796: Status 404 returned error can't find the container with id 9ff5424bfdd0c4358055240f1e9f4e9c40c44e7844be2be9fc284ddd3bc32796 Oct 30 13:14:30.109460 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:30.109424 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" event={"ID":"e21ce9c5-50df-42ce-8777-f956fa7a0b42","Type":"ContainerStarted","Data":"bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0"} Oct 30 13:14:30.109634 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:30.109468 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" event={"ID":"e21ce9c5-50df-42ce-8777-f956fa7a0b42","Type":"ContainerStarted","Data":"9ff5424bfdd0c4358055240f1e9f4e9c40c44e7844be2be9fc284ddd3bc32796"} Oct 30 13:14:30.159680 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:30.159625 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podStartSLOduration=1.159613467 podStartE2EDuration="1.159613467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:14:30.158560361 +0000 UTC m=+1045.388843507" watchObservedRunningTime="2026-10-30 13:14:30.159613467 +0000 UTC m=+1045.389896602" Oct 30 13:14:30.638852 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:30.638813 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:36.840248 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.840184 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8"] Oct 30 13:14:36.844288 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.844263 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:36.871975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.871946 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-ab3176\"/\"openshift-service-ca.crt\"" Oct 30 13:14:36.872155 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.871984 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-ab3176\"/\"kube-root-ca.crt\"" Oct 30 13:14:36.872282 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.872261 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-ab3176\"/\"premium-w6-ab3176-kserve-self-signed-certs\"" Oct 30 13:14:36.872348 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.872291 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-ab3176\"/\"default-dockercfg-lgbnx\"" Oct 30 13:14:36.873938 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.873917 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8"] Oct 30 13:14:36.926032 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.925998 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:36.926233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.926043 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:36.926233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.926129 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:36.926233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.926181 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-656hc\" (UniqueName: \"kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:36.926427 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.926299 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:36.926427 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:36.926417 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.027544 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.027509 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.027893 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.027874 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.028037 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.028023 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.028163 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.028150 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.029621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.029599 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-656hc\" (UniqueName: \"kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.030302 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.030280 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.030882 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.029227 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.031143 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.031111 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.031143 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.028650 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.032502 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.032461 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.033894 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.033853 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.053876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.053557 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-656hc\" (UniqueName: \"kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc\") pod \"premium-w6-ab3176-kserve-799cc5f554-94kf8\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.159315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.159212 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:37.166097 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.166071 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:37.184274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.184248 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:37.470872 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:37.470181 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8"] Oct 30 13:14:38.149805 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:38.149755 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" event={"ID":"3819617d-f020-4a82-bab5-0159bf326856","Type":"ContainerStarted","Data":"9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1"} Oct 30 13:14:38.149805 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:38.149806 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" event={"ID":"3819617d-f020-4a82-bab5-0159bf326856","Type":"ContainerStarted","Data":"3e43cede1c56b04bfab1a593b3fbe8f684e5a87a0a4866fce08b4bec104751c2"} Oct 30 13:14:38.159606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:38.159578 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:38.161971 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:38.161950 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:14:38.189342 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:38.189284 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podStartSLOduration=2.189267692 podStartE2EDuration="2.189267692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:14:38.187493925 +0000 UTC m=+1053.417777065" watchObservedRunningTime="2026-10-30 13:14:38.189267692 +0000 UTC m=+1053.419550826" Oct 30 13:14:39.639077 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:39.639035 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:39.652366 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:39.652336 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:40.174597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:40.174566 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:14:47.159484 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:47.159437 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:47.173632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:47.173601 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:47.209537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:14:47.209512 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:14:59.776054 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:14:59.776011 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:15:01.826120 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.826087 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf"] Oct 30 13:15:01.830432 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.830408 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.854900 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.854875 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-f8a55e\"/\"default-dockercfg-g4m6s\"" Oct 30 13:15:01.855060 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.854937 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-f8a55e\"/\"openshift-service-ca.crt\"" Oct 30 13:15:01.855060 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.854937 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-f8a55e\"/\"premium-w5-f8a55e-kserve-self-signed-certs\"" Oct 30 13:15:01.855060 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.854996 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-f8a55e\"/\"kube-root-ca.crt\"" Oct 30 13:15:01.857910 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.857885 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf"] Oct 30 13:15:01.879352 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.879321 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlfxb\" (UniqueName: \"kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.879352 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.879354 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.879592 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.879372 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.879592 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.879394 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.879698 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.879595 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.879754 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.879696 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981172 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981443 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981297 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfxb\" (UniqueName: \"kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981443 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981326 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981443 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981353 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981443 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981383 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981663 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981477 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.981949 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.981916 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.982497 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.982471 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.982713 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.982692 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.984414 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.984385 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:01.984539 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:01.984515 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:02.017394 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:02.017356 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlfxb\" (UniqueName: \"kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb\") pod \"premium-w5-f8a55e-kserve-77664f447f-w55gf\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:02.150661 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:02.150565 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:02.460863 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:02.460827 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf"] Oct 30 13:15:02.466002 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:15:02.465972 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36d3f59e_3d27_4870_90a6_14d363224b61.slice/crio-eeb72b98a65bb0ff925aad76df3196f9136636d296ac62040a99dec0da85c429 WatchSource:0}: Error finding container eeb72b98a65bb0ff925aad76df3196f9136636d296ac62040a99dec0da85c429: Status 404 returned error can't find the container with id eeb72b98a65bb0ff925aad76df3196f9136636d296ac62040a99dec0da85c429 Oct 30 13:15:03.294338 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:03.294299 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" event={"ID":"36d3f59e-3d27-4870-90a6-14d363224b61","Type":"ContainerStarted","Data":"7a95867f20c86df0706afe198f4c70173fbf7a83ecbe22fd0968ffd7b93db120"} Oct 30 13:15:03.294338 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:03.294345 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" event={"ID":"36d3f59e-3d27-4870-90a6-14d363224b61","Type":"ContainerStarted","Data":"eeb72b98a65bb0ff925aad76df3196f9136636d296ac62040a99dec0da85c429"} Oct 30 13:15:03.361852 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:03.361719 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podStartSLOduration=2.361702522 podStartE2EDuration="2.361702522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:15:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:15:03.359417445 +0000 UTC m=+1078.589700580" watchObservedRunningTime="2026-10-30 13:15:03.361702522 +0000 UTC m=+1078.591985657" Oct 30 13:15:04.151041 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:04.151008 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:12.150972 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:12.150934 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:12.163874 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:12.163848 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:12.347055 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:12.347027 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:15:21.507760 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.507724 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db"] Oct 30 13:15:21.511960 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.511934 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.527742 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.527720 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-d0a18c-openshift-default-dockercfg-jqvd8\"" Oct 30 13:15:21.541830 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.541801 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db"] Oct 30 13:15:21.687052 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687010 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cd7s\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687097 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687132 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687218 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687247 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687270 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687470 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687374 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687470 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687414 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.687569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.687541 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789074 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.788977 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789389 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789362 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cd7s\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789562 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789524 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789675 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789567 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789675 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789602 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789675 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789630 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789675 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789666 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789897 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789749 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.789897 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789817 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.790010 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.789457 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.790548 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.790527 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.791230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.790691 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.791379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.790920 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.791514 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.791127 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.792838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.792817 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.792965 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.792941 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.814364 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.814326 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.814527 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.814395 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cd7s\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:21.825671 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:21.825647 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:22.164555 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.164484 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db"] Oct 30 13:15:22.168259 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:15:22.168234 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcfee04_6fa6_474b_9043_5ce48967c996.slice/crio-f8f0b2f811ef2d07327ca74fda6666231ebbd613564ab99ced7ec9ea01e994d6 WatchSource:0}: Error finding container f8f0b2f811ef2d07327ca74fda6666231ebbd613564ab99ced7ec9ea01e994d6: Status 404 returned error can't find the container with id f8f0b2f811ef2d07327ca74fda6666231ebbd613564ab99ced7ec9ea01e994d6 Oct 30 13:15:22.170745 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.170714 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:22.170812 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.170779 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:22.170812 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.170807 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:22.401341 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.401306 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" event={"ID":"dbcfee04-6fa6-474b-9043-5ce48967c996","Type":"ContainerStarted","Data":"b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888"} Oct 30 13:15:22.401510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.401384 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" event={"ID":"dbcfee04-6fa6-474b-9043-5ce48967c996","Type":"ContainerStarted","Data":"f8f0b2f811ef2d07327ca74fda6666231ebbd613564ab99ced7ec9ea01e994d6"} Oct 30 13:15:22.450907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.450836 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podStartSLOduration=1.4508169419999999 podStartE2EDuration="1.450816942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:15:22.448240635 +0000 UTC m=+1097.678523773" watchObservedRunningTime="2026-10-30 13:15:22.450816942 +0000 UTC m=+1097.681100079" Oct 30 13:15:22.826392 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:22.826305 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:23.827650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:23.827613 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 30 13:15:23.828061 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:23.827665 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 30 13:15:24.826552 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:24.826513 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 30 13:15:24.826733 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:24.826570 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 30 13:15:25.826004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:25.825969 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 30 13:15:25.826433 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:25.826032 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 30 13:15:26.826289 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:26.826253 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 30 13:15:26.826814 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:26.826317 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 30 13:15:27.826664 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:27.826623 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Oct 30 13:15:27.827074 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:27.826681 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Oct 30 13:15:28.874386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:28.874345 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:28.875116 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:28.875094 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:28.876232 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:28.876184 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:15:29.777863 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:15:29.777824 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:15:35.774455 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.774420 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt"] Oct 30 13:15:35.779256 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.779235 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.797785 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.797758 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-031737-openshift-default-dockercfg-77v2d\"" Oct 30 13:15:35.817402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.817375 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt"] Oct 30 13:15:35.868559 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.868525 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.868740 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.868583 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.868740 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.868697 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.868862 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.868842 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.868915 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.868897 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpn6k\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.868992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.868973 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.869047 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.869010 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.869047 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.869032 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.869148 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.869103 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.970620 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970582 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.970824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970654 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpn6k\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.970824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970695 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.970824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970723 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.970824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970747 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.970824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970778 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970871 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970908 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970945 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.970952 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971490 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.971466 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.971475 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.971546 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.971643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.971555 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.973430 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.973410 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.973810 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.973789 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.994076 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.994046 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:35.994331 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:35.994313 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpn6k\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:36.092383 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:36.092287 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:36.414804 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:36.414716 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt"] Oct 30 13:15:36.418881 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:15:36.418852 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92a31db_d713_4977_83bb_734adfae331a.slice/crio-d6f35b8df1dc28f331998479c0e1a3532f3af939a083307c102f9da5e92e11a3 WatchSource:0}: Error finding container d6f35b8df1dc28f331998479c0e1a3532f3af939a083307c102f9da5e92e11a3: Status 404 returned error can't find the container with id d6f35b8df1dc28f331998479c0e1a3532f3af939a083307c102f9da5e92e11a3 Oct 30 13:15:36.421234 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:36.421161 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:36.421336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:36.421258 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:36.421336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:36.421303 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:36.475018 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:36.474989 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" event={"ID":"d92a31db-d713-4977-83bb-734adfae331a","Type":"ContainerStarted","Data":"d6f35b8df1dc28f331998479c0e1a3532f3af939a083307c102f9da5e92e11a3"} Oct 30 13:15:37.487833 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:37.487790 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" event={"ID":"d92a31db-d713-4977-83bb-734adfae331a","Type":"ContainerStarted","Data":"ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a"} Oct 30 13:15:38.093384 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:38.093338 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:38.096871 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:38.096837 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Oct 30 13:15:38.097135 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:38.097108 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Oct 30 13:15:39.150226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:39.146318 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Oct 30 13:15:39.150226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:39.146483 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Oct 30 13:15:39.909233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:39.901288 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded" Oct 30 13:15:39.998224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:39.997300 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:40.137225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:40.113618 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Oct 30 13:15:40.137225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:40.113678 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Oct 30 13:15:40.211340 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:40.211286 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:40.274221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:40.246224 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:40.364979 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:40.364930 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:40.640853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:40.640750 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:41.010223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.009748 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:41.021636 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.021590 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:15:41.030735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.030711 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:15:41.066381 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.066325 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:15:41.066677 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.066649 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:15:41.085227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.084995 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podStartSLOduration=6.084976753 podStartE2EDuration="6.084976753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:15:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:15:37.564644065 +0000 UTC m=+1112.794927192" watchObservedRunningTime="2026-10-30 13:15:41.084976753 +0000 UTC m=+1116.315259889" Oct 30 13:15:41.093290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.093262 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Oct 30 13:15:41.093471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:41.093454 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Oct 30 13:15:42.093506 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:42.093472 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Oct 30 13:15:42.093913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:42.093536 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Oct 30 13:15:43.093022 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:43.092981 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Oct 30 13:15:43.093229 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:43.093053 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Oct 30 13:15:44.359517 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:44.359477 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:44.359965 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:44.359895 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:44.360764 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:44.360743 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:15:45.988972 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:45.988934 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx"] Oct 30 13:15:45.993180 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:45.993156 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.012221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.012181 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-f76c09-openshift-default-dockercfg-z6xv9\"" Oct 30 13:15:46.014710 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.014688 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.014803 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.014785 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.014842 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.014822 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.014879 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.014839 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv95m\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.014977 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.014960 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.015012 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.015003 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.015096 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.015081 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.015132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.015116 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.015164 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.015152 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.043099 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.043020 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx"] Oct 30 13:15:46.115793 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115763 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115804 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115842 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115859 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115885 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115905 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115958 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.115993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.115991 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.116410 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.116015 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv95m\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.116410 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.116259 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.116515 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.116412 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.116515 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.116488 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.116611 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.116496 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.116611 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.116573 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.118624 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.118591 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.119048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.119024 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.144608 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.144580 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv95m\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.150851 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.150826 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.309183 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.309098 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:46.643171 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.643048 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx"] Oct 30 13:15:46.648843 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:15:46.648815 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128c0a65_3a51_4317_8522_9e935d474671.slice/crio-a3bf1bc985895c99fde4499b954eb95044130db06a8a410c357cb2918bcfcf44 WatchSource:0}: Error finding container a3bf1bc985895c99fde4499b954eb95044130db06a8a410c357cb2918bcfcf44: Status 404 returned error can't find the container with id a3bf1bc985895c99fde4499b954eb95044130db06a8a410c357cb2918bcfcf44 Oct 30 13:15:46.651310 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.651273 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:46.651402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.651340 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:46.651402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:46.651369 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:47.609098 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:47.609062 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" event={"ID":"128c0a65-3a51-4317-8522-9e935d474671","Type":"ContainerStarted","Data":"0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289"} Oct 30 13:15:47.609671 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:47.609123 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" event={"ID":"128c0a65-3a51-4317-8522-9e935d474671","Type":"ContainerStarted","Data":"a3bf1bc985895c99fde4499b954eb95044130db06a8a410c357cb2918bcfcf44"} Oct 30 13:15:48.310283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:48.310240 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:48.312118 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:48.312089 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 30 13:15:48.312275 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:48.312141 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 30 13:15:49.310029 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:49.309991 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 30 13:15:49.310488 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:49.310066 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 30 13:15:50.309810 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:50.309771 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 30 13:15:50.310020 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:50.309848 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 30 13:15:51.309757 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.309726 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 30 13:15:51.310142 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.309773 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 30 13:15:51.802159 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.802103 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podStartSLOduration=6.802088856 podStartE2EDuration="6.802088856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:15:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:15:47.692355977 +0000 UTC m=+1122.922639113" watchObservedRunningTime="2026-10-30 13:15:51.802088856 +0000 UTC m=+1127.032372067" Oct 30 13:15:51.802670 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.802647 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n"] Oct 30 13:15:51.806682 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.806666 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.821412 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.821392 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-88f6a4-openshift-default-dockercfg-tgcfz\"" Oct 30 13:15:51.852221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.838707 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n"] Oct 30 13:15:51.904143 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.904108 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.904446 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.904425 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.904621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.904601 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.904792 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.904777 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.904917 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.904902 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.905036 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.905019 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.905188 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.905173 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.905380 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.905363 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krprx\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:51.905533 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:51.905518 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007015 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.006978 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007015 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007018 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007046 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007075 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007113 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007128 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007143 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007183 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007235 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krprx\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007498 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007475 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007584 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007562 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007826 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007803 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.007977 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.007959 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.008244 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.008223 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.009941 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.009919 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.010259 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.010238 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.028871 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.028851 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krprx\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.029366 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.029347 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.120394 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.120304 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:52.309866 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.309831 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body= Oct 30 13:15:52.310289 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.309894 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" Oct 30 13:15:52.516764 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.516658 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n"] Oct 30 13:15:52.520805 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:15:52.520769 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573b5462_e31a_49ae_a5f0_d06f003a4cce.slice/crio-8c613a8abe6bb1abe17a95f4c981a394385657b6f6ed577e608fe19f72aa62fc WatchSource:0}: Error finding container 8c613a8abe6bb1abe17a95f4c981a394385657b6f6ed577e608fe19f72aa62fc: Status 404 returned error can't find the container with id 8c613a8abe6bb1abe17a95f4c981a394385657b6f6ed577e608fe19f72aa62fc Oct 30 13:15:52.523024 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.522993 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:52.523086 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.523061 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:52.523119 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.523093 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:15:52.640233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.638779 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" event={"ID":"573b5462-e31a-49ae-a5f0-d06f003a4cce","Type":"ContainerStarted","Data":"d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d"} Oct 30 13:15:52.640233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.638846 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" event={"ID":"573b5462-e31a-49ae-a5f0-d06f003a4cce","Type":"ContainerStarted","Data":"8c613a8abe6bb1abe17a95f4c981a394385657b6f6ed577e608fe19f72aa62fc"} Oct 30 13:15:52.690651 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:52.689917 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podStartSLOduration=1.689894318 podStartE2EDuration="1.689894318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:15:52.686532731 +0000 UTC m=+1127.916815860" watchObservedRunningTime="2026-10-30 13:15:52.689894318 +0000 UTC m=+1127.920177456" Oct 30 13:15:53.120754 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:53.120720 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:53.122729 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:53.122704 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 30 13:15:53.122863 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:53.122762 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 30 13:15:53.546136 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:53.546096 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:53.550221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:53.547309 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:53.572153 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:53.557569 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:15:54.125412 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:54.125374 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 30 13:15:54.125815 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:54.125784 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 30 13:15:55.122078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:55.122039 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 30 13:15:55.122632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:55.122123 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 30 13:15:56.120942 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:56.120902 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 30 13:15:56.121113 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:56.120977 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 30 13:15:57.121607 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:57.121569 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 30 13:15:57.121997 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:57.121626 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 30 13:15:58.120773 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:58.120669 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body= Oct 30 13:15:58.120773 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:58.120743 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" Oct 30 13:15:59.408645 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:59.408606 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:59.409489 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:59.409464 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:59.410587 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:15:59.410566 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:15:59.776354 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:15:59.776319 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:16:21.225226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.225184 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm"] Oct 30 13:16:21.230272 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.230252 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.244347 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.244314 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-f8a55e-openshift-default-dockercfg-69hv5\"" Oct 30 13:16:21.256879 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.256856 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm"] Oct 30 13:16:21.323309 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323241 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm6xg\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323326 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323343 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323357 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323382 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323538 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323584 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323683 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323616 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.323720 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.323700 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.424743 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424708 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm6xg\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.424928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424763 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.424928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424787 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.424928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424813 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.424928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424851 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.424928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424901 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424933 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.424960 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.425068 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.425155 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425470 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.425448 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425589 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.425571 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425654 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.425578 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.425654 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.425603 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.427456 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.427423 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.428363 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.428345 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.447908 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.447863 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm6xg\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.448076 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.448055 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.543370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.543275 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf"] Oct 30 13:16:21.543532 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.543443 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:21.548344 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.548080 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.565174 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.565145 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-05942d-openshift-default-dockercfg-hrnkn\"" Oct 30 13:16:21.573109 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.573041 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf"] Oct 30 13:16:21.629297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629264 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629424 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629345 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629424 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629382 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629547 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629437 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629547 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629499 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629547 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629541 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkql4\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629573 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629617 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.629703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.629655 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.730699 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.730667 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.730857 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.730718 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.730905 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.730841 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.730948 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.730922 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.730998 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731073 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731035 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731073 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731049 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkql4\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731179 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731083 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731179 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731119 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731179 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731134 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731179 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731172 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731499 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731469 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731616 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.731724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.731702 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.733402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.733379 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.734306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.734279 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.758844 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.758817 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.759116 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.759093 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkql4\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.883416 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.883332 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:21.899089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.897539 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm"] Oct 30 13:16:21.900347 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:16:21.900318 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fcd367_a916_4af5_8c1d_59749515c163.slice/crio-67b9f58d2541c8592195259ef1c9a0ee1008ee4bba81015c476d4015990ced17 WatchSource:0}: Error finding container 67b9f58d2541c8592195259ef1c9a0ee1008ee4bba81015c476d4015990ced17: Status 404 returned error can't find the container with id 67b9f58d2541c8592195259ef1c9a0ee1008ee4bba81015c476d4015990ced17 Oct 30 13:16:21.903325 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.903286 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:21.903446 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.903371 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:21.903446 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.903422 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:21.942325 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:21.942242 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" event={"ID":"e5fcd367-a916-4af5-8c1d-59749515c163","Type":"ContainerStarted","Data":"67b9f58d2541c8592195259ef1c9a0ee1008ee4bba81015c476d4015990ced17"} Oct 30 13:16:22.234088 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.234053 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf"] Oct 30 13:16:22.238426 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:16:22.238397 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1445ab99_2f20_4570_90bd_b7aed1b92ce0.slice/crio-cfbb807a3d350de443a7538a0b07ddc6397245007ad7283e93b92434b56d1563 WatchSource:0}: Error finding container cfbb807a3d350de443a7538a0b07ddc6397245007ad7283e93b92434b56d1563: Status 404 returned error can't find the container with id cfbb807a3d350de443a7538a0b07ddc6397245007ad7283e93b92434b56d1563 Oct 30 13:16:22.242232 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.242166 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:22.242355 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.242259 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:22.242355 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.242307 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:22.986610 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.986563 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" event={"ID":"e5fcd367-a916-4af5-8c1d-59749515c163","Type":"ContainerStarted","Data":"a5dcbfe48107586f111f4ef3c0a099180c60ee6be547519a82e19074dfa56143"} Oct 30 13:16:22.991563 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.991535 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" event={"ID":"1445ab99-2f20-4570-90bd-b7aed1b92ce0","Type":"ContainerStarted","Data":"f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8"} Oct 30 13:16:22.991756 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:22.991589 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" event={"ID":"1445ab99-2f20-4570-90bd-b7aed1b92ce0","Type":"ContainerStarted","Data":"cfbb807a3d350de443a7538a0b07ddc6397245007ad7283e93b92434b56d1563"} Oct 30 13:16:23.039219 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.038787 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podStartSLOduration=2.038767989 podStartE2EDuration="2.038767989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:16:23.030549924 +0000 UTC m=+1158.260833059" watchObservedRunningTime="2026-10-30 13:16:23.038767989 +0000 UTC m=+1158.269051124" Oct 30 13:16:23.549225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.548677 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:23.561800 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.561315 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 30 13:16:23.561800 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.561381 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 30 13:16:23.884631 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.884544 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:23.887885 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.887501 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 30 13:16:23.887885 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:23.887572 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 30 13:16:24.565223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:24.564610 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 30 13:16:24.565223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:24.564673 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 30 13:16:24.890278 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:24.886713 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 30 13:16:24.890278 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:24.886787 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 30 13:16:25.550224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:25.549613 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 30 13:16:25.550224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:25.549674 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 30 13:16:25.885764 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:25.885664 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 30 13:16:25.886357 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:25.886300 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 30 13:16:26.556225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:26.545590 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 30 13:16:26.556225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:26.545650 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 30 13:16:26.885282 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:26.884725 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 30 13:16:26.885282 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:26.884804 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 30 13:16:27.549223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:27.547600 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 30 13:16:27.549223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:27.547666 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 30 13:16:27.883950 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:27.883751 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 30 13:16:27.883950 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:27.883818 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 30 13:16:28.544989 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:28.544944 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body= Oct 30 13:16:28.545188 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:28.545033 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" Oct 30 13:16:28.884507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:28.884415 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Oct 30 13:16:28.884507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:28.884494 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Oct 30 13:16:29.549374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.549342 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:29.549818 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.549798 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:29.550478 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.550457 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:16:29.609022 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.608972 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podStartSLOduration=8.60895645 podStartE2EDuration="8.60895645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:16:23.091555073 +0000 UTC m=+1158.321838209" watchObservedRunningTime="2026-10-30 13:16:29.60895645 +0000 UTC m=+1164.839239651" Oct 30 13:16:29.777405 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:16:29.777374 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:16:29.888033 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.887965 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:29.888413 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.888252 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:29.888904 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:29.888888 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:16:31.205431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.205394 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg"] Oct 30 13:16:31.209318 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.209296 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228152 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228121 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksstp\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228278 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228168 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228340 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228316 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228404 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228388 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228483 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228463 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228610 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228593 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228648 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228698 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228689 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.228833 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.228805 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.253497 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.253467 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg"] Oct 30 13:16:31.330402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330365 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330404 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksstp\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330426 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330443 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330481 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330499 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330568 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330611 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.330662 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330646 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.331083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330922 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.331083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.330922 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.331083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.331066 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.331264 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.331158 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.331425 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.331392 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.333070 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.333042 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.333292 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.333270 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.363977 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.363946 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksstp\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.364395 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.364378 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.524145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.524064 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:31.865949 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.865922 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg"] Oct 30 13:16:31.868599 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:16:31.868563 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab13cf0_4b26_4a77_93fb_18ccfee54324.slice/crio-b515de442389f8b5db8643ddad9c741ff50245282bc31dd46bea2986d4e81b36 WatchSource:0}: Error finding container b515de442389f8b5db8643ddad9c741ff50245282bc31dd46bea2986d4e81b36: Status 404 returned error can't find the container with id b515de442389f8b5db8643ddad9c741ff50245282bc31dd46bea2986d4e81b36 Oct 30 13:16:31.871152 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.871113 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:31.871285 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.871251 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:31.871352 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:31.871301 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:32.049485 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:32.049445 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" event={"ID":"dab13cf0-4b26-4a77-93fb-18ccfee54324","Type":"ContainerStarted","Data":"1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808"} Oct 30 13:16:32.049673 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:32.049512 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" event={"ID":"dab13cf0-4b26-4a77-93fb-18ccfee54324","Type":"ContainerStarted","Data":"b515de442389f8b5db8643ddad9c741ff50245282bc31dd46bea2986d4e81b36"} Oct 30 13:16:32.109004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:32.108955 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podStartSLOduration=1.108939223 podStartE2EDuration="1.108939223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:16:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:16:32.107467591 +0000 UTC m=+1167.337750738" watchObservedRunningTime="2026-10-30 13:16:32.108939223 +0000 UTC m=+1167.339222358" Oct 30 13:16:32.524842 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:32.524807 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:32.526451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:32.526428 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:32.526567 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:32.526475 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:33.525003 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:33.524964 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:33.525436 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:33.525019 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:34.524932 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:34.524890 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:34.525287 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:34.525158 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:35.528221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:35.527613 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:35.528221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:35.527674 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:36.029868 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.029818 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg"] Oct 30 13:16:36.042500 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.042474 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.113225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.101332 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg"] Oct 30 13:16:36.140870 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.140831 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.141234 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.141185 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.141409 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.141392 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.145349 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.145322 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.145680 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.145660 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.145835 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.145819 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.145967 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.145951 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-742v7\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.146139 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.146113 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.146363 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.146337 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.252840 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.252907 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.253017 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.253044 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.253072 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-742v7\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.253113 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.253174 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.256656 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.258272 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.258588 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.259118 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.260118 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.260249 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.261221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.260532 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.286685 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.286612 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.287751 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.287698 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.304694 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.304639 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.304878 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.304851 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-742v7\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.379483 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.379453 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:36.524957 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.524920 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:36.525114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.524986 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:36.924977 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.924946 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg"] Oct 30 13:16:36.929144 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:16:36.929113 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod857794d7_c674_48eb_b10e_91335ad04aa2.slice/crio-87b5368dfb18a99c380c08fdc0262cc3baf6e21ca549435e2001453ea4b52445 WatchSource:0}: Error finding container 87b5368dfb18a99c380c08fdc0262cc3baf6e21ca549435e2001453ea4b52445: Status 404 returned error can't find the container with id 87b5368dfb18a99c380c08fdc0262cc3baf6e21ca549435e2001453ea4b52445 Oct 30 13:16:36.941220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.931623 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:36.941474 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.941441 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:36.941626 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:36.941604 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:16:37.196059 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:37.196019 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" event={"ID":"857794d7-c674-48eb-b10e-91335ad04aa2","Type":"ContainerStarted","Data":"5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff"} Oct 30 13:16:37.196250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:37.196092 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" event={"ID":"857794d7-c674-48eb-b10e-91335ad04aa2","Type":"ContainerStarted","Data":"87b5368dfb18a99c380c08fdc0262cc3baf6e21ca549435e2001453ea4b52445"} Oct 30 13:16:37.381752 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:37.381157 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:37.525288 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:37.525188 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:37.525288 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:37.525259 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:38.383473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:38.383428 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 30 13:16:38.383975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:38.383492 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 30 13:16:38.525019 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:38.524987 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Oct 30 13:16:38.525176 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:38.525046 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Oct 30 13:16:39.383223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:39.381509 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 30 13:16:39.383223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:39.381558 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 30 13:16:39.529736 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:39.529703 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:39.530144 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:39.530108 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:39.530844 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:39.530822 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:16:39.587731 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:39.587669 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podStartSLOduration=4.587648992 podStartE2EDuration="4.587648992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:16:37.274558682 +0000 UTC m=+1172.504841828" watchObservedRunningTime="2026-10-30 13:16:39.587648992 +0000 UTC m=+1174.817932128" Oct 30 13:16:40.380616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:40.380579 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 30 13:16:40.380881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:40.380849 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 30 13:16:41.380514 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:41.380474 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 30 13:16:41.380920 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:41.380555 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 30 13:16:42.380866 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:42.380820 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 30 13:16:42.381412 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:42.380877 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 30 13:16:43.380432 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:43.380391 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Oct 30 13:16:43.380606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:43.380468 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Oct 30 13:16:44.385336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:44.385300 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:44.385797 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:44.385708 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:44.386556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:16:44.386537 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:16:59.778178 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:16:59.778132 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:17:04.985158 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:04.985130 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:17:04.990482 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:04.990458 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:17:06.434785 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.434752 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss"] Oct 30 13:17:06.439579 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.439563 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.465361 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.465221 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss"] Oct 30 13:17:06.502449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502413 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502637 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502460 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502637 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502617 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502752 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502653 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502795 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502749 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502844 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502805 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502844 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502833 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502927 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502909 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.502971 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.502952 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbxcz\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604407 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604375 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604425 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604601 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604465 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604732 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604618 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbxcz\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604732 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604688 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604731 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604752 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604850 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604880 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.604984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.604937 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.605146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.605005 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.605243 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.605187 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.605322 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.605300 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.605407 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.605392 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.607020 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.606998 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.607228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.607191 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.626573 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.626546 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.626739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.626725 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbxcz\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:06.753405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:06.753317 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:07.099125 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.099040 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss"] Oct 30 13:17:07.102264 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:17:07.102236 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f851213_2b5d_4db3_a904_e4f6869dfe67.slice/crio-ef407fc9b0bdfb7b04e4fcbda467c762f049573486c012d6776f6b0216db4743 WatchSource:0}: Error finding container ef407fc9b0bdfb7b04e4fcbda467c762f049573486c012d6776f6b0216db4743: Status 404 returned error can't find the container with id ef407fc9b0bdfb7b04e4fcbda467c762f049573486c012d6776f6b0216db4743 Oct 30 13:17:07.104780 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.104744 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:07.104860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.104814 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:07.104860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.104851 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:07.406042 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.405945 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" event={"ID":"6f851213-2b5d-4db3-a904-e4f6869dfe67","Type":"ContainerStarted","Data":"036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf"} Oct 30 13:17:07.406042 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.406005 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" event={"ID":"6f851213-2b5d-4db3-a904-e4f6869dfe67","Type":"ContainerStarted","Data":"ef407fc9b0bdfb7b04e4fcbda467c762f049573486c012d6776f6b0216db4743"} Oct 30 13:17:07.450464 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.450408 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podStartSLOduration=1.4503923859999999 podStartE2EDuration="1.450392386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:17:07.447569773 +0000 UTC m=+1202.677852909" watchObservedRunningTime="2026-10-30 13:17:07.450392386 +0000 UTC m=+1202.680675522" Oct 30 13:17:07.754042 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:07.754013 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:08.758299 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:08.758268 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 30 13:17:08.758782 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:08.758330 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 30 13:17:09.756365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:09.756331 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 30 13:17:09.756658 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:09.756631 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 30 13:17:10.757661 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:10.757615 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 30 13:17:10.758187 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:10.757716 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 30 13:17:11.757223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:11.756566 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 30 13:17:11.757223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:11.756638 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 30 13:17:12.762745 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:12.762707 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 30 13:17:12.763368 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:12.762770 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 30 13:17:13.758906 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:13.755532 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Oct 30 13:17:13.758906 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:13.755607 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Oct 30 13:17:14.758316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:14.758284 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:14.758861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:14.758843 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:14.759542 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:14.759519 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:17:20.347902 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.345364 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9"] Oct 30 13:17:20.360471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.360443 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.379355 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.378972 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-031737\"/\"distinct-w0-031737-kserve-self-signed-certs\"" Oct 30 13:17:20.392435 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.392410 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9"] Oct 30 13:17:20.512510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.512473 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.513140 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.513117 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.513650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.513631 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.517304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.517274 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.517410 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.517361 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.517480 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.517423 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8pz\" (UniqueName: \"kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.626282 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.626143 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.626282 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.626263 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.626537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.626348 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.626537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.626433 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8pz\" (UniqueName: \"kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.626537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.626493 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.626706 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.626620 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.630221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.627329 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.630221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.627697 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.630221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.628171 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.684565 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.684464 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.684787 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.684717 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.696821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.690256 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8pz\" (UniqueName: \"kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz\") pod \"distinct-w0-031737-kserve-78cc7c6c9d-k5zd9\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:20.696821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:20.696433 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:21.072904 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.071100 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9"] Oct 30 13:17:21.176151 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.176122 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk"] Oct 30 13:17:21.179907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.179873 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.206227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.205703 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk"] Oct 30 13:17:21.245210 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245175 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245263 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245312 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245353 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245566 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245506 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245566 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245555 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245642 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245604 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245675 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245665 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.245735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.245722 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b85s6\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346620 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346691 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346773 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346808 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b85s6\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346861 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346885 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346938 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.346988 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.347123 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347771 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.347441 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347771 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.347552 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347771 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.347730 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.347977 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.347958 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.348573 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.348190 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.349734 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.349708 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.350407 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.350386 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.371053 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.371027 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b85s6\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.371179 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.371127 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token\") pod \"e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.494726 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.494699 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:21.529501 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.529466 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" event={"ID":"3c2cb2b9-aac1-4467-ac11-e0857265414a","Type":"ContainerStarted","Data":"f203f201b4993af082a3e2d70a9477ac0265c7177dbcd773deedd4e20dd88372"} Oct 30 13:17:21.529654 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.529523 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" event={"ID":"3c2cb2b9-aac1-4467-ac11-e0857265414a","Type":"ContainerStarted","Data":"59c4637d1d562a884cd8302cae94318b595a825d50b7c7ec8606d4be918783bc"} Oct 30 13:17:21.578554 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.578499 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podStartSLOduration=1.578478412 podStartE2EDuration="1.578478412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:17:21.578453349 +0000 UTC m=+1216.808736495" watchObservedRunningTime="2026-10-30 13:17:21.578478412 +0000 UTC m=+1216.808761562" Oct 30 13:17:21.697806 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.697776 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:21.830040 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.830008 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk"] Oct 30 13:17:21.833716 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:17:21.833675 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcd7d15_0b50_4950_ba7e_26bcbb8c9fc6.slice/crio-185936e71901740ba0cefe39ce56fa44037fb3a9c9e21fd9ea91bf96704ee454 WatchSource:0}: Error finding container 185936e71901740ba0cefe39ce56fa44037fb3a9c9e21fd9ea91bf96704ee454: Status 404 returned error can't find the container with id 185936e71901740ba0cefe39ce56fa44037fb3a9c9e21fd9ea91bf96704ee454 Oct 30 13:17:21.836191 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.836153 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:21.836337 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.836289 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:21.836401 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:21.836338 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:22.544321 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:22.544190 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" event={"ID":"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6","Type":"ContainerStarted","Data":"c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c"} Oct 30 13:17:22.544321 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:22.544272 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" event={"ID":"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6","Type":"ContainerStarted","Data":"185936e71901740ba0cefe39ce56fa44037fb3a9c9e21fd9ea91bf96704ee454"} Oct 30 13:17:22.597511 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:22.597416 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podStartSLOduration=1.597398386 podStartE2EDuration="1.597398386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:17:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:17:22.596922824 +0000 UTC m=+1217.827205961" watchObservedRunningTime="2026-10-30 13:17:22.597398386 +0000 UTC m=+1217.827681525" Oct 30 13:17:23.495285 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:23.495241 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:23.496891 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:23.496868 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Oct 30 13:17:23.497028 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:23.496915 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Oct 30 13:17:24.495564 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:24.495524 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Oct 30 13:17:24.495978 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:24.495604 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Oct 30 13:17:25.495899 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:25.495861 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Oct 30 13:17:25.496403 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:25.495917 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Oct 30 13:17:26.495459 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:26.495420 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Oct 30 13:17:26.495648 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:26.495470 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Oct 30 13:17:27.495730 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:27.495696 4498 patch_prober.go:29] interesting pod/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Oct 30 13:17:27.496189 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:27.495749 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Oct 30 13:17:28.505280 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:28.505249 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:28.505898 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:28.505661 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:28.507076 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:28.507057 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:17:29.780124 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:17:29.780088 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:17:30.697842 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:30.697809 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:30.710777 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:30.710754 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:31.630339 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:31.630312 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:17:36.833433 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.833399 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g"] Oct 30 13:17:36.837387 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.837365 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.864141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.864101 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g"] Oct 30 13:17:36.922338 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922306 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922338 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922339 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922370 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922540 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922578 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922731 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922687 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922779 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922727 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922779 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922764 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:36.922880 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:36.922781 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8qn\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.023872 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.023840 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024064 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.023879 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024064 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024007 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024213 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024092 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024213 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024120 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024213 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024173 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024261 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024310 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024330 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8qn\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024444 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024504 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024651 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024617 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024651 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024638 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.024994 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.024969 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.026557 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.026532 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.026652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.026628 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.046898 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.046867 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8qn\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.051866 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.051841 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.151019 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.150925 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:37.492105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.492083 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g"] Oct 30 13:17:37.494953 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:17:37.494929 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df91573_184f_4975_b3cd_0daa9a552c12.slice/crio-719850ce8da734a963455a821113773481e52eaf7a642400904642fd8dd74593 WatchSource:0}: Error finding container 719850ce8da734a963455a821113773481e52eaf7a642400904642fd8dd74593: Status 404 returned error can't find the container with id 719850ce8da734a963455a821113773481e52eaf7a642400904642fd8dd74593 Oct 30 13:17:37.497533 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.497502 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:37.497594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.497571 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:37.497631 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.497603 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:37.707106 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.707071 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" event={"ID":"1df91573-184f-4975-b3cd-0daa9a552c12","Type":"ContainerStarted","Data":"ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817"} Oct 30 13:17:37.707336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.707138 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" event={"ID":"1df91573-184f-4975-b3cd-0daa9a552c12","Type":"ContainerStarted","Data":"719850ce8da734a963455a821113773481e52eaf7a642400904642fd8dd74593"} Oct 30 13:17:37.752087 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:37.751955 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podStartSLOduration=1.7519383130000001 podStartE2EDuration="1.751938313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:17:37.751596179 +0000 UTC m=+1232.981879315" watchObservedRunningTime="2026-10-30 13:17:37.751938313 +0000 UTC m=+1232.982221450" Oct 30 13:17:38.154351 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:38.154250 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:38.164116 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:38.164081 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:38.164388 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:38.164139 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:39.154221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:39.153619 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:39.154221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:39.153726 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:40.153666 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:40.153631 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:40.153948 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:40.153917 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:41.154376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:41.154343 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:41.155010 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:41.154963 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:42.154222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:42.152573 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:42.154222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:42.152633 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:43.156632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:43.156592 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:43.157259 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:43.157185 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:44.151521 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:44.151484 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Oct 30 13:17:44.151720 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:44.151549 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Oct 30 13:17:45.156090 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:45.156052 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:45.156555 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:45.156430 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:45.157249 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:45.157233 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:17:52.139261 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.139226 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j"] Oct 30 13:17:52.144479 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.144462 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.168788 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.168759 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.168975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.168876 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.168975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.168950 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.169244 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.169216 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.169385 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.169361 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.169449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.169406 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.169449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.169427 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.169544 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.169484 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knr6l\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.169544 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.169523 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.182548 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.182514 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j"] Oct 30 13:17:52.195515 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.195484 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld"] Oct 30 13:17:52.199387 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.199367 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.268554 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.268522 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld"] Oct 30 13:17:52.270744 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270717 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.270881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270749 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.270881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270778 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.270881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270801 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270886 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270922 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knr6l\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270949 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.271046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.270987 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.271046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271011 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.271356 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271051 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271356 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271095 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271356 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271127 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.271356 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271222 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271356 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271274 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271574 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271675 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271651 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.271873 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271853 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.271948 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.271911 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.272092 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.272067 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.272240 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.272145 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.272323 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.272256 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzsq\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.272386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.272322 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.272830 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.272810 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.288389 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.274856 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.288389 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.285446 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.297562 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.297532 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.302788 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.302757 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knr6l\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.373340 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373303 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373365 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373480 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373653 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373566 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373653 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373641 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373714 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373804 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373763 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373844 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzsq\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.373942 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373924 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.374001 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373977 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.374050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.373994 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.374050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.374037 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.374346 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.374323 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.374796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.374769 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.376310 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.376285 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.376746 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.376725 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.399852 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.399777 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.399982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.399850 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzsq\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq\") pod \"e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.459931 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.459892 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:52.517401 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.517378 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:52.803250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.802537 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j"] Oct 30 13:17:52.835361 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.835008 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:52.835361 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.835070 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:52.835361 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.835099 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:52.854080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.854030 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld"] Oct 30 13:17:52.860694 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:17:52.860443 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d7199a_e822_4f39_9880_fedafd700532.slice/crio-b015201375e159570971dc21da67cf6dec908f05105b5fd49f59c3b21816377c WatchSource:0}: Error finding container b015201375e159570971dc21da67cf6dec908f05105b5fd49f59c3b21816377c: Status 404 returned error can't find the container with id b015201375e159570971dc21da67cf6dec908f05105b5fd49f59c3b21816377c Oct 30 13:17:52.881741 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.880842 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:52.881741 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.880931 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:52.881741 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:52.880973 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:17:53.874973 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:53.874930 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" event={"ID":"2b2e44f6-ba31-4d19-9c52-5bc30252fc56","Type":"ContainerStarted","Data":"6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89"} Oct 30 13:17:53.875638 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:53.875611 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" event={"ID":"2b2e44f6-ba31-4d19-9c52-5bc30252fc56","Type":"ContainerStarted","Data":"e2b524f1a25156c65305db4e94abefc5cc1070f07d9c1ad0d5a6f3c413ea78af"} Oct 30 13:17:53.886816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:53.886783 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" event={"ID":"88d7199a-e822-4f39-9880-fedafd700532","Type":"ContainerStarted","Data":"98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d"} Oct 30 13:17:53.887105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:53.887065 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" event={"ID":"88d7199a-e822-4f39-9880-fedafd700532","Type":"ContainerStarted","Data":"b015201375e159570971dc21da67cf6dec908f05105b5fd49f59c3b21816377c"} Oct 30 13:17:53.982180 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:53.982122 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podStartSLOduration=1.98209998 podStartE2EDuration="1.98209998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:17:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:17:53.959772309 +0000 UTC m=+1249.190055448" watchObservedRunningTime="2026-10-30 13:17:53.98209998 +0000 UTC m=+1249.212383116" Oct 30 13:17:54.032224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.007031 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podStartSLOduration=2.007013372 podStartE2EDuration="2.007013372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:17:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:17:54.004791068 +0000 UTC m=+1249.235074204" watchObservedRunningTime="2026-10-30 13:17:54.007013372 +0000 UTC m=+1249.237296508" Oct 30 13:17:54.462464 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.462427 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:17:54.462827 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.462802 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:17:54.462987 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.462961 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:17:54.525225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.523995 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:17:54.525225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.524130 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:17:54.525225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:54.524174 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:17:55.180223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:55.172289 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:17:55.201235 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:55.200486 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:17:55.464870 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:55.464780 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:17:55.480316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:55.480268 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:17:55.522113 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:55.522080 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:17:55.522395 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:55.522369 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:17:56.485273 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:56.481664 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:17:56.485273 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:56.481726 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:17:56.518871 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:56.518828 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:17:56.519055 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:56.518898 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:17:57.462227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:57.461666 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:17:57.462227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:57.461737 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:17:57.518856 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:57.518507 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:17:57.518856 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:57.518561 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:17:58.464647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:58.464602 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:17:58.464835 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:58.464670 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:17:58.518760 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:58.518726 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:17:58.518969 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:58.518779 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:17:59.460650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:59.460609 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:17:59.461032 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:59.461002 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:17:59.518580 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:59.518542 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:17:59.518819 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:17:59.518798 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:17:59.813667 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:17:59.813572 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:18:00.461152 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:00.461114 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Oct 30 13:18:00.461376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:00.461186 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Oct 30 13:18:00.518934 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:00.518897 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:18:00.519129 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:00.518958 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:18:01.518765 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:01.518730 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body= Oct 30 13:18:01.519343 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:01.518791 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" Oct 30 13:18:01.896776 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:01.896261 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:18:01.897667 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:01.897645 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:18:01.898959 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:01.898933 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:18:02.524054 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:02.524026 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:18:02.524560 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:02.524436 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:18:02.525276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:02.525258 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:18:06.678072 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.678037 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t"] Oct 30 13:18:06.682167 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.682149 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.705089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.705058 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t"] Oct 30 13:18:06.789361 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789331 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789519 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789370 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wgzd\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789561 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789524 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789561 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789553 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789577 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789594 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789747 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789733 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789786 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789761 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.789786 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.789779 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891082 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891052 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891082 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891089 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891107 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891233 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891291 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891327 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891347 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891462 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891468 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891722 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891538 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wgzd\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.891722 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891627 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.892001 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.891976 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.892101 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.892048 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.892159 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.892097 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.893710 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.893683 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.893936 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.893915 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.913471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.913448 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.913732 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.913712 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wgzd\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd\") pod \"e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:06.996461 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:06.996437 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:07.336144 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:07.336068 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t"] Oct 30 13:18:07.340107 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:18:07.340076 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f76a94c_f20d_478a_aa36_1aed830ec94b.slice/crio-3d5dae3d90e16bb6f47a057e03f181257305ae7195a76e89a517f0fe78d9cf0c WatchSource:0}: Error finding container 3d5dae3d90e16bb6f47a057e03f181257305ae7195a76e89a517f0fe78d9cf0c: Status 404 returned error can't find the container with id 3d5dae3d90e16bb6f47a057e03f181257305ae7195a76e89a517f0fe78d9cf0c Oct 30 13:18:07.342929 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:07.342894 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:18:07.343004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:07.342961 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:18:07.343004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:07.342990 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:18:08.268113 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:08.268072 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" event={"ID":"2f76a94c-f20d-478a-aa36-1aed830ec94b","Type":"ContainerStarted","Data":"07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f"} Oct 30 13:18:08.268577 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:08.268137 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" event={"ID":"2f76a94c-f20d-478a-aa36-1aed830ec94b","Type":"ContainerStarted","Data":"3d5dae3d90e16bb6f47a057e03f181257305ae7195a76e89a517f0fe78d9cf0c"} Oct 30 13:18:08.348222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:08.340375 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podStartSLOduration=2.340355406 podStartE2EDuration="2.340355406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:18:08.330648697 +0000 UTC m=+1263.560931833" watchObservedRunningTime="2026-10-30 13:18:08.340355406 +0000 UTC m=+1263.570638542" Oct 30 13:18:09.011223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:09.009413 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:09.011223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:09.009570 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 30 13:18:09.011223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:09.009620 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 30 13:18:09.998720 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:09.998677 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 30 13:18:09.999359 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:09.999324 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 30 13:18:10.174333 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:10.174288 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:10.633223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:10.632288 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:10.645260 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:10.644298 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:10.905420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:10.905317 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:11.000646 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.000173 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 30 13:18:11.000646 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.000248 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 30 13:18:11.175452 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.175352 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:11.176339 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.176317 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:18:11.811996 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.811967 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:18:11.998045 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.998013 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 30 13:18:11.998229 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:11.998078 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 30 13:18:12.997043 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:12.997008 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 30 13:18:12.997463 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:12.997058 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 30 13:18:13.996753 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:13.996721 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body= Oct 30 13:18:13.996927 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:13.996772 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" Oct 30 13:18:15.374646 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:15.374594 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:15.375964 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:15.375945 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:15.376680 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:15.376656 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:18:29.850220 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:18:29.847372 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:18:37.069205 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.069170 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj"] Oct 30 13:18:37.074190 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.074165 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.110881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.110849 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj"] Oct 30 13:18:37.248222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248164 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248406 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248243 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248406 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248339 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248534 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248404 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248534 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248510 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248648 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248556 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248659 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248765 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248710 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bcwf\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.248879 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.248860 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.349958 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350046 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350020 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350324 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350053 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350324 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350091 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350324 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350149 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bcwf\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350324 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350270 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350327 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350384 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350415 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350518 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350775 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350753 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.350907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.350878 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.351102 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.351076 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.351243 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.351118 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.352905 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.352879 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.353080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.353061 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.372065 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.372034 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.372258 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.372235 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bcwf\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf\") pod \"e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.389360 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.389341 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:37.714385 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.714192 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj"] Oct 30 13:18:37.717378 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:18:37.717353 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da603be_e2cf_4373_9bbb_db864a0ba8cb.slice/crio-24231362dcefc3c2d7e0de6f15393722b356ae092f796933b709351f6714052f WatchSource:0}: Error finding container 24231362dcefc3c2d7e0de6f15393722b356ae092f796933b709351f6714052f: Status 404 returned error can't find the container with id 24231362dcefc3c2d7e0de6f15393722b356ae092f796933b709351f6714052f Oct 30 13:18:37.719860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.719825 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:18:37.719941 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.719895 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:18:37.719941 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.719925 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:18:37.838418 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.838373 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" event={"ID":"7da603be-e2cf-4373-9bbb-db864a0ba8cb","Type":"ContainerStarted","Data":"edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7"} Oct 30 13:18:37.838581 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.838439 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" event={"ID":"7da603be-e2cf-4373-9bbb-db864a0ba8cb","Type":"ContainerStarted","Data":"24231362dcefc3c2d7e0de6f15393722b356ae092f796933b709351f6714052f"} Oct 30 13:18:37.882239 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:37.881961 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podStartSLOduration=0.881944791 podStartE2EDuration="881.944791ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:18:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:18:37.880839478 +0000 UTC m=+1293.111122613" watchObservedRunningTime="2026-10-30 13:18:37.881944791 +0000 UTC m=+1293.112227926" Oct 30 13:18:38.390598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:38.390567 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:38.391767 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:38.391742 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:38.391824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:38.391804 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:39.389881 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:39.389842 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:39.390074 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:39.389911 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:40.397641 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:40.397599 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:40.398325 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:40.398288 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:41.206360 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.206305 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:41.342421 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.342362 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:41.394221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.393632 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:41.394221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.393710 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:41.629283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.628297 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:41.698222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.697569 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": context deadline exceeded" Oct 30 13:18:41.823224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.822520 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:41.907286 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.905538 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:41.999236 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:41.996296 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:42.160282 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.159285 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:42.455223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.446680 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": context deadline exceeded" Oct 30 13:18:42.455223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.447125 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:18:42.472224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.461984 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:42.472224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.462035 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:42.596549 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.596519 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:18:42.632442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.632405 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:42.634737 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.634708 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:18:42.878494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.878385 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:18:42.922330 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.922283 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:42.960225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.927462 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:18:42.960225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:42.927546 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:18:43.036250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.033946 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 30 13:18:43.036250 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.034354 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:43.219008 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.218964 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/health\": context deadline exceeded" Oct 30 13:18:43.249459 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.222677 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:43.347224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.326833 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:18:43.469289 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.451971 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:43.469289 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.452032 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:43.726878 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.726800 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:18:43.759998 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.750305 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:43.877230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.859317 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:43.905344 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:43.905299 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:44.007405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:44.007083 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:18:44.022340 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:44.022160 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:18:44.059224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:44.056703 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:18:44.131101 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:44.131073 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:18:44.389962 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:44.389880 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:44.389962 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:44.389940 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:45.390146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:45.390117 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:45.390607 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:45.390167 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:46.389959 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:46.389930 4498 patch_prober.go:29] interesting pod/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body= Oct 30 13:18:46.390130 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:46.389981 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" Oct 30 13:18:47.394793 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:47.394757 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:47.395222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:47.395069 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:47.395740 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:18:47.395720 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:18:59.776453 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:18:59.776417 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:19:01.092899 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:01.087523 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf"] Oct 30 13:19:02.188415 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:02.188348 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:02.945383 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:02.945344 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:19:02.945700 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:02.945669 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:03.572446 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:03.572389 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:19:03.573092 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:03.573057 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:03.770364 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:03.770318 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:04.048364 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.048319 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:04.102730 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.048608 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:04.104026 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.049324 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:19:04.173643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.068293 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:04.332412 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.175950 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded" Oct 30 13:19:04.387236 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.257288 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:04.607690 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.607401 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:04.846778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.846732 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": context deadline exceeded" Oct 30 13:19:04.887292 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:04.877088 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:19:05.178364 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:05.177662 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:19:05.180136 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:05.178983 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:19:05.256164 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:05.256111 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:19:05.263713 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:05.263688 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:19:16.486040 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:16.485993 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" containerID="cri-o://7a95867f20c86df0706afe198f4c70173fbf7a83ecbe22fd0968ffd7b93db120" gracePeriod=45 Oct 30 13:19:16.597527 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:16.597486 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" probeResult="failure" output="Get \"https://10.133.0.50:8000/ready\": dial tcp 10.133.0.50:8000: connect: connection refused" Oct 30 13:19:16.788652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:16.788330 4498 generic.go:356] "Generic (PLEG): container finished" podID="36d3f59e-3d27-4870-90a6-14d363224b61" containerID="7a95867f20c86df0706afe198f4c70173fbf7a83ecbe22fd0968ffd7b93db120" exitCode=0 Oct 30 13:19:16.788652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:16.788465 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" event={"ID":"36d3f59e-3d27-4870-90a6-14d363224b61","Type":"ContainerDied","Data":"7a95867f20c86df0706afe198f4c70173fbf7a83ecbe22fd0968ffd7b93db120"} Oct 30 13:19:17.006222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.005494 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:19:17.115319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.094649 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb\" (UniqueName: \"kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb\") pod \"36d3f59e-3d27-4870-90a6-14d363224b61\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " Oct 30 13:19:17.115319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.094750 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir\") pod \"36d3f59e-3d27-4870-90a6-14d363224b61\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " Oct 30 13:19:17.115319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.094785 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache\") pod \"36d3f59e-3d27-4870-90a6-14d363224b61\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " Oct 30 13:19:17.115319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.094907 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs\" (UniqueName: \"kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs\") pod \"36d3f59e-3d27-4870-90a6-14d363224b61\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " Oct 30 13:19:17.115319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.094973 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm\") pod \"36d3f59e-3d27-4870-90a6-14d363224b61\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " Oct 30 13:19:17.115319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.095025 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home\") pod \"36d3f59e-3d27-4870-90a6-14d363224b61\" (UID: \"36d3f59e-3d27-4870-90a6-14d363224b61\") " Oct 30 13:19:17.130054 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.115876 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home" pod "36d3f59e-3d27-4870-90a6-14d363224b61" (UID: "36d3f59e-3d27-4870-90a6-14d363224b61"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:17.130054 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.127521 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache" pod "36d3f59e-3d27-4870-90a6-14d363224b61" (UID: "36d3f59e-3d27-4870-90a6-14d363224b61"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:17.130054 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.127715 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir" pod "36d3f59e-3d27-4870-90a6-14d363224b61" (UID: "36d3f59e-3d27-4870-90a6-14d363224b61"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:17.186499 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.186430 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm" pod "36d3f59e-3d27-4870-90a6-14d363224b61" (UID: "36d3f59e-3d27-4870-90a6-14d363224b61"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:17.226223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.207390 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:17.226223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.207433 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:17.226223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.207447 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:17.226223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.207462 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36d3f59e-3d27-4870-90a6-14d363224b61-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:17.246423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.246357 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs" pod "36d3f59e-3d27-4870-90a6-14d363224b61" (UID: "36d3f59e-3d27-4870-90a6-14d363224b61"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:19:17.249984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.249951 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb" pod "36d3f59e-3d27-4870-90a6-14d363224b61" (UID: "36d3f59e-3d27-4870-90a6-14d363224b61"). InnerVolumeSpecName "kube-api-access-vlfxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:17.325295 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.325255 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlfxb\" (UniqueName: \"kubernetes.io/projected/36d3f59e-3d27-4870-90a6-14d363224b61-kube-api-access-vlfxb\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:17.325555 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.325529 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36d3f59e-3d27-4870-90a6-14d363224b61-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:17.828555 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.828518 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" event={"ID":"36d3f59e-3d27-4870-90a6-14d363224b61","Type":"ContainerDied","Data":"eeb72b98a65bb0ff925aad76df3196f9136636d296ac62040a99dec0da85c429"} Oct 30 13:19:17.829158 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.829108 4498 scope.go:122] "RemoveContainer" containerID="7a95867f20c86df0706afe198f4c70173fbf7a83ecbe22fd0968ffd7b93db120" Oct 30 13:19:17.829451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.829434 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf" Oct 30 13:19:17.974225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.956581 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf"] Oct 30 13:19:17.996408 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:17.995955 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-f8a55e/premium-w5-f8a55e-kserve-77664f447f-w55gf"] Oct 30 13:19:18.901104 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:18.901062 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" path="/var/lib/kubelet/pods/36d3f59e-3d27-4870-90a6-14d363224b61/volumes" Oct 30 13:19:23.588848 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:23.588815 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9"] Oct 30 13:19:23.672500 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:23.672304 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb"] Oct 30 13:19:29.888537 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:19:29.888467 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:19:38.615569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:38.615387 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" containerID="cri-o://f203f201b4993af082a3e2d70a9477ac0265c7177dbcd773deedd4e20dd88372" gracePeriod=45 Oct 30 13:19:38.706499 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:38.706415 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" containerID="cri-o://e8f4e10666945d332b4219c400431fd63712450c79266cb1579ac7084d3635cc" gracePeriod=45 Oct 30 13:19:39.041426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:39.041131 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": dial tcp 10.133.0.60:8000: connect: connection refused" Oct 30 13:19:39.218255 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:39.217601 4498 generic.go:356] "Generic (PLEG): container finished" podID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerID="f203f201b4993af082a3e2d70a9477ac0265c7177dbcd773deedd4e20dd88372" exitCode=0 Oct 30 13:19:39.218255 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:39.217672 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" event={"ID":"3c2cb2b9-aac1-4467-ac11-e0857265414a","Type":"ContainerDied","Data":"f203f201b4993af082a3e2d70a9477ac0265c7177dbcd773deedd4e20dd88372"} Oct 30 13:19:39.262237 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:39.258644 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": dial tcp 10.133.0.44:8000: connect: connection refused" Oct 30 13:19:40.112405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.110315 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:40.243328 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.214893 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:40.279245 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.264416 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:19:40.340406 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.338306 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" probeResult="failure" output="Get \"https://10.133.0.44:8000/ready\": dial tcp 10.133.0.44:8000: connect: connection refused" Oct 30 13:19:40.340406 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.338436 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:19:40.354357 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.354259 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.467250 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm\") pod \"3c2cb2b9-aac1-4467-ac11-e0857265414a\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.467657 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs\") pod \"3c2cb2b9-aac1-4467-ac11-e0857265414a\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.467704 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache\") pod \"3c2cb2b9-aac1-4467-ac11-e0857265414a\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.468295 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz\" (UniqueName: \"kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz\") pod \"3c2cb2b9-aac1-4467-ac11-e0857265414a\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.468466 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir\") pod \"3c2cb2b9-aac1-4467-ac11-e0857265414a\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.468602 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home\") pod \"3c2cb2b9-aac1-4467-ac11-e0857265414a\" (UID: \"3c2cb2b9-aac1-4467-ac11-e0857265414a\") " Oct 30 13:19:40.471569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.470919 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home" pod "3c2cb2b9-aac1-4467-ac11-e0857265414a" (UID: "3c2cb2b9-aac1-4467-ac11-e0857265414a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:40.481938 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.472483 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir" pod "3c2cb2b9-aac1-4467-ac11-e0857265414a" (UID: "3c2cb2b9-aac1-4467-ac11-e0857265414a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:40.503472 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.496569 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache" pod "3c2cb2b9-aac1-4467-ac11-e0857265414a" (UID: "3c2cb2b9-aac1-4467-ac11-e0857265414a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:40.591303 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.586440 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:40.591303 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.586478 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:40.591303 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.586491 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:40.635492 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.633750 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm" pod "3c2cb2b9-aac1-4467-ac11-e0857265414a" (UID: "3c2cb2b9-aac1-4467-ac11-e0857265414a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:40.691224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.679297 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:19:40.691224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.679377 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:40.736333 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.708856 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2cb2b9-aac1-4467-ac11-e0857265414a-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:40.762222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.744369 4498 generic.go:356] "Generic (PLEG): container finished" podID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerID="e8f4e10666945d332b4219c400431fd63712450c79266cb1579ac7084d3635cc" exitCode=0 Oct 30 13:19:40.762222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.744516 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" event={"ID":"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57","Type":"ContainerDied","Data":"e8f4e10666945d332b4219c400431fd63712450c79266cb1579ac7084d3635cc"} Oct 30 13:19:40.762222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.754432 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:40.779222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.768356 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs" pod "3c2cb2b9-aac1-4467-ac11-e0857265414a" (UID: "3c2cb2b9-aac1-4467-ac11-e0857265414a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:19:40.779222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.770049 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" event={"ID":"3c2cb2b9-aac1-4467-ac11-e0857265414a","Type":"ContainerDied","Data":"59c4637d1d562a884cd8302cae94318b595a825d50b7c7ec8606d4be918783bc"} Oct 30 13:19:40.779222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.770099 4498 scope.go:122] "RemoveContainer" containerID="f203f201b4993af082a3e2d70a9477ac0265c7177dbcd773deedd4e20dd88372" Oct 30 13:19:40.863862 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.801602 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:19:40.938874 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:40.938467 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2cb2b9-aac1-4467-ac11-e0857265414a-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.019234 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.017666 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:41.057227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.053773 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9" Oct 30 13:19:41.128546 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.128441 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz" pod "3c2cb2b9-aac1-4467-ac11-e0857265414a" (UID: "3c2cb2b9-aac1-4467-ac11-e0857265414a"). InnerVolumeSpecName "kube-api-access-wb8pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:41.164625 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.157286 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:41.164625 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.158024 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:19:41.217762 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.215899 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb8pz\" (UniqueName: \"kubernetes.io/projected/3c2cb2b9-aac1-4467-ac11-e0857265414a-kube-api-access-wb8pz\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.284228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.281284 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:19:41.284228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.282264 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:19:41.324224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.321301 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:19:41.437660 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.437623 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs\") pod \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " Oct 30 13:19:41.447223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.443297 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir\") pod \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " Oct 30 13:19:41.451222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.447470 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home\") pod \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " Oct 30 13:19:41.462230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.456428 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache\") pod \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " Oct 30 13:19:41.466227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.462542 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm\") pod \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " Oct 30 13:19:41.474316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.474287 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx\" (UniqueName: \"kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx\") pod \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\" (UID: \"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57\") " Oct 30 13:19:41.501223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.457302 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir" pod "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" (UID: "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:41.774391 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.464522 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home" pod "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" (UID: "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:41.774391 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.481296 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache" pod "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" (UID: "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:41.774391 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.583684 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm" pod "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" (UID: "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:41.774391 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.748372 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx" pod "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" (UID: "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57"). InnerVolumeSpecName "kube-api-access-5jckx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:41.805103 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.804663 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:19:41.834306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.832912 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.834306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.832943 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.834306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.832957 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jckx\" (UniqueName: \"kubernetes.io/projected/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-kube-api-access-5jckx\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.834306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.832971 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.834306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.832983 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:41.887666 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.852373 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs" pod "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" (UID: "0ca47bfd-2e2f-405f-8080-b3a18bd7bc57"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:19:41.951677 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.915028 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" event={"ID":"0ca47bfd-2e2f-405f-8080-b3a18bd7bc57","Type":"ContainerDied","Data":"d6d848e0dd32de1010bcc414002844ba6bd720cd8d9ccd3539618945f556f3a9"} Oct 30 13:19:41.951677 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.918953 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb" Oct 30 13:19:41.951677 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.921442 4498 scope.go:122] "RemoveContainer" containerID="e8f4e10666945d332b4219c400431fd63712450c79266cb1579ac7084d3635cc" Oct 30 13:19:41.961241 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:41.953036 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:42.152224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.140921 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 30 13:19:42.173578 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.172298 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:42.302279 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.298371 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:42.400769 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.400655 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9"] Oct 30 13:19:42.427224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.426299 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" probeResult="failure" output="Get \"https://10.133.0.47:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:42.432223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.429478 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-031737/distinct-w0-031737-kserve-78cc7c6c9d-k5zd9"] Oct 30 13:19:42.538237 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.534271 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb"] Oct 30 13:19:42.558277 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.541830 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-031737/simulator-w0-031737-kserve-7dbf9b6cfd-mrwcb"] Oct 30 13:19:42.788298 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.788259 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss"] Oct 30 13:19:42.789190 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.789157 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" containerID="cri-o://036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf" gracePeriod=30 Oct 30 13:19:42.820370 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:42.820280 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:19:43.212224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.186394 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": context deadline exceeded" Oct 30 13:19:43.216221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.213301 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:43.269016 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:19:43.268976 4498 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ca47bfd_2e2f_405f_8080_b3a18bd7bc57.slice\": RecentStats: unable to find data in memory cache]" Oct 30 13:19:43.354089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.354047 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded" Oct 30 13:19:43.595569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.593291 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" path="/var/lib/kubelet/pods/0ca47bfd-2e2f-405f-8080-b3a18bd7bc57/volumes" Oct 30 13:19:43.595569 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.593977 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" path="/var/lib/kubelet/pods/3c2cb2b9-aac1-4467-ac11-e0857265414a/volumes" Oct 30 13:19:43.609469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.596334 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:19:43.609469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.596389 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:19:43.609469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.596413 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t"] Oct 30 13:19:43.609469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.596611 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" containerID="cri-o://07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f" gracePeriod=30 Oct 30 13:19:43.610075 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.610048 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm"] Oct 30 13:19:43.610453 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.610422 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" containerID="cri-o://a5dcbfe48107586f111f4ef3c0a099180c60ee6be547519a82e19074dfa56143" gracePeriod=30 Oct 30 13:19:43.756224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:43.748722 4498 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/health\": context deadline exceeded" Oct 30 13:19:44.017230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.008069 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:19:44.220838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.220773 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:19:44.253385 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.253345 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:19:44.437776 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.437740 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:19:44.631348 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.631297 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 13:19:44.635398 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.635335 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 13:19:44.760713 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.760625 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 13:19:44.760963 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:44.760935 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 13:19:45.185660 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.185625 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw"] Oct 30 13:19:45.186435 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186408 4498 cpu_manager.go:414] "containerMap: removing container" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" Oct 30 13:19:45.186435 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186435 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" Oct 30 13:19:45.186639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186462 4498 cpu_manager.go:414] "containerMap: removing container" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" Oct 30 13:19:45.186639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186471 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" Oct 30 13:19:45.186639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186499 4498 cpu_manager.go:414] "containerMap: removing container" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" Oct 30 13:19:45.186639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186508 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" Oct 30 13:19:45.186831 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186661 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ca47bfd-2e2f-405f-8080-b3a18bd7bc57" containerName="main" Oct 30 13:19:45.186831 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186676 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="36d3f59e-3d27-4870-90a6-14d363224b61" containerName="main" Oct 30 13:19:45.186831 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.186689 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c2cb2b9-aac1-4467-ac11-e0857265414a" containerName="main" Oct 30 13:19:45.192796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.192769 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.206482 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.206446 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-88f6a4\"/\"distinct-w4-88f6a4-kserve-self-signed-certs\"" Oct 30 13:19:45.210271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.210243 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw"] Oct 30 13:19:45.288965 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.288937 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.289376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.288989 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.289376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.289021 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.289376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.289167 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.289376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.289264 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2vg5\" (UniqueName: \"kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.289376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.289366 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.379389 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.378124 4498 patch_prober.go:29] interesting pod/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 13:19:45.379389 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.378178 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 13:19:45.390690 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.390659 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2vg5\" (UniqueName: \"kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.390857 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.390748 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.390857 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.390843 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.390975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.390903 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.390975 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.390936 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.391082 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.390976 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.391311 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.391291 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.391395 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.391369 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.391804 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.391780 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.393352 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.393323 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.393647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.393626 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.411984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.411961 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2vg5\" (UniqueName: \"kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5\") pod \"distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.508836 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.508749 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:45.961726 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:45.961690 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw"] Oct 30 13:19:45.965750 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:19:45.965707 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb45ebbb_cffc_4221_ae94_9ede32f187f4.slice/crio-64684c2c939d2e8b4cc7270558f1da51b7c488d6f90f7fa52bfe24cfc42033e4 WatchSource:0}: Error finding container 64684c2c939d2e8b4cc7270558f1da51b7c488d6f90f7fa52bfe24cfc42033e4: Status 404 returned error can't find the container with id 64684c2c939d2e8b4cc7270558f1da51b7c488d6f90f7fa52bfe24cfc42033e4 Oct 30 13:19:46.632870 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:46.632829 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" event={"ID":"cb45ebbb-cffc-4221-ae94-9ede32f187f4","Type":"ContainerStarted","Data":"220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193"} Oct 30 13:19:46.633366 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:46.632884 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" event={"ID":"cb45ebbb-cffc-4221-ae94-9ede32f187f4","Type":"ContainerStarted","Data":"64684c2c939d2e8b4cc7270558f1da51b7c488d6f90f7fa52bfe24cfc42033e4"} Oct 30 13:19:46.673859 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:46.673775 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" podStartSLOduration=1.6737554879999998 podStartE2EDuration="1.673755488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:19:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:19:46.672147613 +0000 UTC m=+1361.902430751" watchObservedRunningTime="2026-10-30 13:19:46.673755488 +0000 UTC m=+1361.904038624" Oct 30 13:19:47.509255 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:47.509224 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:49.205936 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.205908 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:19:49.349663 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349590 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.349663 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349643 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.349898 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349713 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.349898 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349750 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.349898 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349813 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.350044 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349901 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.350044 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.349951 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.350044 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350003 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.350044 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350039 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.350275 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350092 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.350275 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350119 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token\") pod \"6f851213-2b5d-4db3-a904-e4f6869dfe67\" (UID: \"6f851213-2b5d-4db3-a904-e4f6869dfe67\") " Oct 30 13:19:49.350275 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350175 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.350415 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350363 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:19:49.350694 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350664 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.350838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350708 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.350838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350729 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.350838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350742 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.350838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.350754 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f851213-2b5d-4db3-a904-e4f6869dfe67-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.352463 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.352430 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:49.352591 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.352465 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "kube-api-access-dbxcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:49.352591 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.352533 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:19:49.352839 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.352821 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy" pod "6f851213-2b5d-4db3-a904-e4f6869dfe67" (UID: "6f851213-2b5d-4db3-a904-e4f6869dfe67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.452447 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.452415 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.452447 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.452448 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.452670 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.452464 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.452670 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.452477 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbxcz\" (UniqueName: \"kubernetes.io/projected/6f851213-2b5d-4db3-a904-e4f6869dfe67-kube-api-access-dbxcz\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.452670 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.452492 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f851213-2b5d-4db3-a904-e4f6869dfe67-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.660228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.658700 4498 generic.go:356] "Generic (PLEG): container finished" podID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerID="036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf" exitCode=0 Oct 30 13:19:49.660228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.658877 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" event={"ID":"6f851213-2b5d-4db3-a904-e4f6869dfe67","Type":"ContainerDied","Data":"036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf"} Oct 30 13:19:49.660228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.658925 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" event={"ID":"6f851213-2b5d-4db3-a904-e4f6869dfe67","Type":"ContainerDied","Data":"ef407fc9b0bdfb7b04e4fcbda467c762f049573486c012d6776f6b0216db4743"} Oct 30 13:19:49.660228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.658954 4498 scope.go:122] "RemoveContainer" containerID="036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf" Oct 30 13:19:49.660228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.659097 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss" Oct 30 13:19:49.662819 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.662744 4498 generic.go:356] "Generic (PLEG): container finished" podID="e5fcd367-a916-4af5-8c1d-59749515c163" containerID="a5dcbfe48107586f111f4ef3c0a099180c60ee6be547519a82e19074dfa56143" exitCode=0 Oct 30 13:19:49.662922 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.662782 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" event={"ID":"e5fcd367-a916-4af5-8c1d-59749515c163","Type":"ContainerDied","Data":"a5dcbfe48107586f111f4ef3c0a099180c60ee6be547519a82e19074dfa56143"} Oct 30 13:19:49.733471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.731864 4498 scope.go:122] "RemoveContainer" containerID="036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf" Oct 30 13:19:49.733471 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:19:49.732427 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf\": container with ID starting with 036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf not found: ID does not exist" containerID="036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf" Oct 30 13:19:49.733471 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.732462 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf"} err="failed to get container status \"036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf\": rpc error: code = NotFound desc = could not find container \"036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf\": container with ID starting with 036fa7f81b0379ef1ecb948c54ea7ee712172c5dd5a59ded31ef90062bdd88bf not found: ID does not exist" Oct 30 13:19:49.749913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.749882 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss"] Oct 30 13:19:49.753261 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.753236 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xnqss"] Oct 30 13:19:49.802582 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.802552 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:19:49.938709 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.938629 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:19:49.972264 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972237 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972428 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972275 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972428 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972309 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972428 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972359 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972592 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972439 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972592 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972546 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972592 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972575 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972743 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972589 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.972743 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972643 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972743 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972680 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket\") pod \"e5fcd367-a916-4af5-8c1d-59749515c163\" (UID: \"e5fcd367-a916-4af5-8c1d-59749515c163\") " Oct 30 13:19:49.972743 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972692 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.972951 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972786 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.972951 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.972918 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:19:49.973074 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.973046 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.973332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.973308 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.973332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.973334 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fcd367-a916-4af5-8c1d-59749515c163-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.973523 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.973347 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.973523 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.973362 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.973523 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.973377 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:49.974873 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.974850 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:49.974963 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.974896 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "kube-api-access-fm6xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:49.975068 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.975050 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:19:49.975183 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:49.975166 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token" pod "e5fcd367-a916-4af5-8c1d-59749515c163" (UID: "e5fcd367-a916-4af5-8c1d-59749515c163"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:50.074253 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074222 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074440 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074264 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074440 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074305 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074440 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074355 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074459 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074524 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074548 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074586 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:50.074828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074617 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074653 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token\") pod \"2f76a94c-f20d-478a-aa36-1aed830ec94b\" (UID: \"2f76a94c-f20d-478a-aa36-1aed830ec94b\") " Oct 30 13:19:50.074828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.074715 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:50.075067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075046 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:19:50.075316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075275 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075492 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075636 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fcd367-a916-4af5-8c1d-59749515c163-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075653 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm6xg\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-kube-api-access-fm6xg\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075663 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075672 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f76a94c-f20d-478a-aa36-1aed830ec94b-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075680 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fcd367-a916-4af5-8c1d-59749515c163-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075688 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fcd367-a916-4af5-8c1d-59749515c163-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.075708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.075695 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.076681 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.076657 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:19:50.076763 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.076736 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:19:50.077375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.077355 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:50.077654 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.077639 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd" pod "2f76a94c-f20d-478a-aa36-1aed830ec94b" (UID: "2f76a94c-f20d-478a-aa36-1aed830ec94b"). InnerVolumeSpecName "kube-api-access-2wgzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:19:50.176796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.176696 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.176796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.176733 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.176796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.176778 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.176796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.176793 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.177145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.176818 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wgzd\" (UniqueName: \"kubernetes.io/projected/2f76a94c-f20d-478a-aa36-1aed830ec94b-kube-api-access-2wgzd\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.177145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.176833 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f76a94c-f20d-478a-aa36-1aed830ec94b-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:19:50.670531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.670493 4498 generic.go:356] "Generic (PLEG): container finished" podID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerID="07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f" exitCode=0 Oct 30 13:19:50.671015 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.670545 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" Oct 30 13:19:50.671015 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.670576 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" event={"ID":"2f76a94c-f20d-478a-aa36-1aed830ec94b","Type":"ContainerDied","Data":"07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f"} Oct 30 13:19:50.671015 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.670629 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t" event={"ID":"2f76a94c-f20d-478a-aa36-1aed830ec94b","Type":"ContainerDied","Data":"3d5dae3d90e16bb6f47a057e03f181257305ae7195a76e89a517f0fe78d9cf0c"} Oct 30 13:19:50.671015 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.670650 4498 scope.go:122] "RemoveContainer" containerID="07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f" Oct 30 13:19:50.673494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.673469 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" event={"ID":"e5fcd367-a916-4af5-8c1d-59749515c163","Type":"ContainerDied","Data":"67b9f58d2541c8592195259ef1c9a0ee1008ee4bba81015c476d4015990ced17"} Oct 30 13:19:50.673597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.673532 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm" Oct 30 13:19:50.688366 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.688344 4498 scope.go:122] "RemoveContainer" containerID="07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f" Oct 30 13:19:50.689151 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:19:50.689126 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f\": container with ID starting with 07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f not found: ID does not exist" containerID="07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f" Oct 30 13:19:50.689291 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.689161 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f"} err="failed to get container status \"07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f\": rpc error: code = NotFound desc = could not find container \"07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f\": container with ID starting with 07297ee904e65e1ccc2a1e0aa23b92311566dd516232d5c1f5fa32c69ceff58f not found: ID does not exist" Oct 30 13:19:50.689291 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.689187 4498 scope.go:122] "RemoveContainer" containerID="a5dcbfe48107586f111f4ef3c0a099180c60ee6be547519a82e19074dfa56143" Oct 30 13:19:50.733451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.733425 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t"] Oct 30 13:19:50.737341 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.737319 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-xt64t"] Oct 30 13:19:50.776427 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.776396 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm"] Oct 30 13:19:50.800013 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.799986 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-f8a55e-openshift-default-6cf69f7695-d9pmm"] Oct 30 13:19:50.901982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.901955 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" path="/var/lib/kubelet/pods/2f76a94c-f20d-478a-aa36-1aed830ec94b/volumes" Oct 30 13:19:50.902440 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.902417 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" path="/var/lib/kubelet/pods/6f851213-2b5d-4db3-a904-e4f6869dfe67/volumes" Oct 30 13:19:50.902911 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:50.902893 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" path="/var/lib/kubelet/pods/e5fcd367-a916-4af5-8c1d-59749515c163/volumes" Oct 30 13:19:55.509674 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:55.509641 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:55.522423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:55.522395 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:55.718522 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:19:55.718495 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:19:59.786158 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:19:59.786119 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:20:00.279277 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.279237 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6"] Oct 30 13:20:00.279557 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.279528 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" podUID="57e5719f-45f9-48af-8606-a8e8cb1b9c02" containerName="maas-api" containerID="cri-o://514fb816106c1bc77bc12a4b803d8bcb661aac28e22bb9fccb76a011cda08c27" gracePeriod=30 Oct 30 13:20:00.764420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.751764 4498 generic.go:356] "Generic (PLEG): container finished" podID="57e5719f-45f9-48af-8606-a8e8cb1b9c02" containerID="514fb816106c1bc77bc12a4b803d8bcb661aac28e22bb9fccb76a011cda08c27" exitCode=0 Oct 30 13:20:00.764420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.751836 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" event={"ID":"57e5719f-45f9-48af-8606-a8e8cb1b9c02","Type":"ContainerDied","Data":"514fb816106c1bc77bc12a4b803d8bcb661aac28e22bb9fccb76a011cda08c27"} Oct 30 13:20:00.764420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.751885 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" event={"ID":"57e5719f-45f9-48af-8606-a8e8cb1b9c02","Type":"ContainerDied","Data":"f8280ca995ff9e195d182bf2ec83ded2f07491db25653ab5918b9048be3ee014"} Oct 30 13:20:00.764420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.751908 4498 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8280ca995ff9e195d182bf2ec83ded2f07491db25653ab5918b9048be3ee014" Oct 30 13:20:00.792225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.791654 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.864899 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m\" (UniqueName: \"kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m\") pod \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.864968 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca\") pod \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.865005 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs\") pod \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.865102 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls\") pod \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\" (UID: \"57e5719f-45f9-48af-8606-a8e8cb1b9c02\") " Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.866086 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca" pod "57e5719f-45f9-48af-8606-a8e8cb1b9c02" (UID: "57e5719f-45f9-48af-8606-a8e8cb1b9c02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.868654 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls" pod "57e5719f-45f9-48af-8606-a8e8cb1b9c02" (UID: "57e5719f-45f9-48af-8606-a8e8cb1b9c02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:20:00.869226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.868927 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs" pod "57e5719f-45f9-48af-8606-a8e8cb1b9c02" (UID: "57e5719f-45f9-48af-8606-a8e8cb1b9c02"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:20:00.870625 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.870600 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m" pod "57e5719f-45f9-48af-8606-a8e8cb1b9c02" (UID: "57e5719f-45f9-48af-8606-a8e8cb1b9c02"). InnerVolumeSpecName "kube-api-access-sz64m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:00.967224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.967168 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:00.967224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.967226 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz64m\" (UniqueName: \"kubernetes.io/projected/57e5719f-45f9-48af-8606-a8e8cb1b9c02-kube-api-access-sz64m\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:00.967425 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.967240 4498 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57e5719f-45f9-48af-8606-a8e8cb1b9c02-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:00.967425 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:00.967249 4498 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/57e5719f-45f9-48af-8606-a8e8cb1b9c02-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:01.795222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:01.783676 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6" Oct 30 13:20:01.860964 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:01.859285 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6"] Oct 30 13:20:01.922220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:01.910942 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-031737-784b655d79-6mlw6"] Oct 30 13:20:01.990796 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:01.990766 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9"] Oct 30 13:20:02.002082 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002050 4498 cpu_manager.go:414] "containerMap: removing container" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" Oct 30 13:20:02.002331 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002309 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" Oct 30 13:20:02.002510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002493 4498 cpu_manager.go:414] "containerMap: removing container" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" Oct 30 13:20:02.002614 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002601 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" Oct 30 13:20:02.002702 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002692 4498 cpu_manager.go:414] "containerMap: removing container" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" Oct 30 13:20:02.002792 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002781 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" Oct 30 13:20:02.002901 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002890 4498 cpu_manager.go:414] "containerMap: removing container" podUID="57e5719f-45f9-48af-8606-a8e8cb1b9c02" containerName="maas-api" Oct 30 13:20:02.002980 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.002967 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57e5719f-45f9-48af-8606-a8e8cb1b9c02" containerName="maas-api" Oct 30 13:20:02.003231 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.003215 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5fcd367-a916-4af5-8c1d-59749515c163" containerName="istio-proxy" Oct 30 13:20:02.003358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.003346 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f851213-2b5d-4db3-a904-e4f6869dfe67" containerName="istio-proxy" Oct 30 13:20:02.003440 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.003429 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f76a94c-f20d-478a-aa36-1aed830ec94b" containerName="istio-proxy" Oct 30 13:20:02.003536 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.003525 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="57e5719f-45f9-48af-8606-a8e8cb1b9c02" containerName="maas-api" Oct 30 13:20:02.015982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.015954 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.063666 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.063590 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9"] Oct 30 13:20:02.155233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.123847 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.155233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.123918 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwvj\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.155233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.123988 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.155233 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.124041 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.156992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.155716 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.156992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.155805 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.156992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.155886 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.156992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.155948 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.156992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.155979 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.289131 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.264935 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343363 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343534 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343598 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343668 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343697 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343727 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343779 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.343835 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwvj\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.289906 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.345271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.344644 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.358232 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.346558 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.358475 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.349108 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.379405 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.349348 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.416224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.392109 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwvj\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.421574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.421544 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.429232 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.421879 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.449261 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.443768 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token\") pod \"e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.626045 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.625750 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:02.769838 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.769219 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.67:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:02.822190 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.820294 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:02.996970 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:02.996182 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57e5719f-45f9-48af-8606-a8e8cb1b9c02" path="/var/lib/kubelet/pods/57e5719f-45f9-48af-8606-a8e8cb1b9c02/volumes" Oct 30 13:20:03.210249 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.195663 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded" Oct 30 13:20:03.626238 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.613159 4498 patch_prober.go:29] interesting pod/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:20:03.626238 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.613280 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:03.778222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.771220 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:03.778222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.773419 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:20:03.778222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.777990 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9"] Oct 30 13:20:03.847316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.847271 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:03.848161 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.848005 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:20:03.945532 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.879166 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:20:03.945876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.945840 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:20:03.946222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:03.946181 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:20:04.346253 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:04.318300 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:04.796230 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:04.788461 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" probeResult="failure" output="Get \"https://10.133.0.67:8000/ready\": context deadline exceeded" Oct 30 13:20:04.870244 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:04.860301 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" probeResult="failure" output="Get \"https://10.133.0.48:8000/ready\": context deadline exceeded" Oct 30 13:20:05.087130 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.087096 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:20:05.268450 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.268418 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" event={"ID":"89d4357e-e83f-4fff-a979-8a15e767a0ab","Type":"ContainerStarted","Data":"7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432"} Oct 30 13:20:05.268710 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.268690 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" event={"ID":"89d4357e-e83f-4fff-a979-8a15e767a0ab","Type":"ContainerStarted","Data":"5c665f79945ac4530cfd791800b0e61e6412d2efc268fcf7f653b9085340f5ce"} Oct 30 13:20:05.271543 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.268839 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c"] Oct 30 13:20:05.271765 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.271740 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt"] Oct 30 13:20:05.327221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.275872 4498 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Oct 30 13:20:05.361304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.340782 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:05.361304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.234237 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" probeResult="failure" output="Get \"https://10.133.0.46:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:05.361304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.341380 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:20:05.361304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.341943 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" probeResult="failure" output="Get \"https://10.133.0.45:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:05.362983 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.178981 4498 scope.go:122] "RemoveContainer" containerID="514fb816106c1bc77bc12a4b803d8bcb661aac28e22bb9fccb76a011cda08c27" Oct 30 13:20:05.447813 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.447762 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podStartSLOduration=4.447731938 podStartE2EDuration="4.447731938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:20:05.311143564 +0000 UTC m=+1380.541426700" watchObservedRunningTime="2026-10-30 13:20:05.447731938 +0000 UTC m=+1380.678015074" Oct 30 13:20:05.480220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.476885 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:20:05.628079 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.628054 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:05.630300 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.630277 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:05.630504 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:05.630479 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:06.344320 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:06.344277 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 30 13:20:06.620597 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:06.620513 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:20:06.627809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:06.627773 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:06.644433 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:06.628036 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:07.627126 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:07.627094 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:07.627640 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:07.627148 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:08.626952 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:08.626916 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:08.627171 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:08.626974 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:09.626989 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:09.626954 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:09.627157 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:09.627014 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:10.627528 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:10.627489 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:10.628041 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:10.627549 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:11.626876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:11.626841 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body= Oct 30 13:20:11.627060 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:11.626898 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" Oct 30 13:20:13.106308 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:13.106273 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:13.106991 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:13.106690 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:13.107821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:13.107802 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:20:20.493538 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.493408 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" containerID="cri-o://cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e" gracePeriod=45 Oct 30 13:20:20.555178 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.555127 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" containerID="cri-o://bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0" gracePeriod=45 Oct 30 13:20:20.753312 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.748995 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf"] Oct 30 13:20:20.753312 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.750493 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" containerID="cri-o://f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8" gracePeriod=30 Oct 30 13:20:20.768583 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.768547 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g"] Oct 30 13:20:20.769109 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.769082 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" containerID="cri-o://ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817" gracePeriod=30 Oct 30 13:20:20.795885 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.794100 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj"] Oct 30 13:20:20.795885 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.794345 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" containerID="cri-o://edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7" gracePeriod=30 Oct 30 13:20:20.987513 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:20.987490 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:20:21.003396 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.003332 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:20:21.060171 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.060131 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home\") pod \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " Oct 30 13:20:21.060374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.060183 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir\") pod \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " Oct 30 13:20:21.060374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.060252 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm\") pod \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " Oct 30 13:20:21.060506 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.060463 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57\" (UniqueName: \"kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57\") pod \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " Oct 30 13:20:21.060506 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.060499 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache\") pod \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " Oct 30 13:20:21.060615 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.060560 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs\" (UniqueName: \"kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs\") pod \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\" (UID: \"e21ce9c5-50df-42ce-8777-f956fa7a0b42\") " Oct 30 13:20:21.063259 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.063230 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home" pod "e21ce9c5-50df-42ce-8777-f956fa7a0b42" (UID: "e21ce9c5-50df-42ce-8777-f956fa7a0b42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.063435 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.063416 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir" pod "e21ce9c5-50df-42ce-8777-f956fa7a0b42" (UID: "e21ce9c5-50df-42ce-8777-f956fa7a0b42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.065449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.065408 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache" pod "e21ce9c5-50df-42ce-8777-f956fa7a0b42" (UID: "e21ce9c5-50df-42ce-8777-f956fa7a0b42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.065551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.065437 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs" pod "e21ce9c5-50df-42ce-8777-f956fa7a0b42" (UID: "e21ce9c5-50df-42ce-8777-f956fa7a0b42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:20:21.066968 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.066940 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm" pod "e21ce9c5-50df-42ce-8777-f956fa7a0b42" (UID: "e21ce9c5-50df-42ce-8777-f956fa7a0b42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.067650 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.067615 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57" pod "e21ce9c5-50df-42ce-8777-f956fa7a0b42" (UID: "e21ce9c5-50df-42ce-8777-f956fa7a0b42"). InnerVolumeSpecName "kube-api-access-wxj57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:21.162813 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.162778 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs\" (UniqueName: \"kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs\") pod \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " Oct 30 13:20:21.162976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.162835 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf\" (UniqueName: \"kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf\") pod \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " Oct 30 13:20:21.162976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.162894 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir\") pod \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " Oct 30 13:20:21.162976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.162959 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm\") pod \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " Oct 30 13:20:21.163160 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.163008 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home\") pod \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " Oct 30 13:20:21.163160 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.163113 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache\") pod \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\" (UID: \"4d3a501f-1d4f-4abb-899f-2db484cb8d69\") " Oct 30 13:20:21.163408 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.163374 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home" pod "4d3a501f-1d4f-4abb-899f-2db484cb8d69" (UID: "4d3a501f-1d4f-4abb-899f-2db484cb8d69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.163589 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.163551 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir" pod "4d3a501f-1d4f-4abb-899f-2db484cb8d69" (UID: "4d3a501f-1d4f-4abb-899f-2db484cb8d69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.163689 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.163657 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache" pod "4d3a501f-1d4f-4abb-899f-2db484cb8d69" (UID: "4d3a501f-1d4f-4abb-899f-2db484cb8d69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.164019 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.163993 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.164830 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.164808 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxj57\" (UniqueName: \"kubernetes.io/projected/e21ce9c5-50df-42ce-8777-f956fa7a0b42-kube-api-access-wxj57\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.165085 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.165067 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.165188 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.165176 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.165301 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.165289 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.165391 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.165380 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.166442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.166391 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.166442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.166409 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e21ce9c5-50df-42ce-8777-f956fa7a0b42-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.166442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.166230 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm" pod "4d3a501f-1d4f-4abb-899f-2db484cb8d69" (UID: "4d3a501f-1d4f-4abb-899f-2db484cb8d69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:21.166442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.166423 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.166442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.166417 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf" pod "4d3a501f-1d4f-4abb-899f-2db484cb8d69" (UID: "4d3a501f-1d4f-4abb-899f-2db484cb8d69"). InnerVolumeSpecName "kube-api-access-cf9nf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:21.168089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.168067 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs" pod "4d3a501f-1d4f-4abb-899f-2db484cb8d69" (UID: "4d3a501f-1d4f-4abb-899f-2db484cb8d69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:20:21.267621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.267535 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4d3a501f-1d4f-4abb-899f-2db484cb8d69-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.267621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.267567 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf9nf\" (UniqueName: \"kubernetes.io/projected/4d3a501f-1d4f-4abb-899f-2db484cb8d69-kube-api-access-cf9nf\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.267621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.267579 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4d3a501f-1d4f-4abb-899f-2db484cb8d69-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:21.439048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.439009 4498 generic.go:356] "Generic (PLEG): container finished" podID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerID="bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0" exitCode=0 Oct 30 13:20:21.439247 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.439066 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" Oct 30 13:20:21.439247 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.439095 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" event={"ID":"e21ce9c5-50df-42ce-8777-f956fa7a0b42","Type":"ContainerDied","Data":"bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0"} Oct 30 13:20:21.439247 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.439147 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c" event={"ID":"e21ce9c5-50df-42ce-8777-f956fa7a0b42","Type":"ContainerDied","Data":"9ff5424bfdd0c4358055240f1e9f4e9c40c44e7844be2be9fc284ddd3bc32796"} Oct 30 13:20:21.439247 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.439174 4498 scope.go:122] "RemoveContainer" containerID="bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0" Oct 30 13:20:21.440938 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.440917 4498 generic.go:356] "Generic (PLEG): container finished" podID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerID="cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e" exitCode=0 Oct 30 13:20:21.441028 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.440998 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" event={"ID":"4d3a501f-1d4f-4abb-899f-2db484cb8d69","Type":"ContainerDied","Data":"cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e"} Oct 30 13:20:21.441028 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.441017 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" Oct 30 13:20:21.441141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.441036 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt" event={"ID":"4d3a501f-1d4f-4abb-899f-2db484cb8d69","Type":"ContainerDied","Data":"836991377d386f47efad3859c721be430cf5a7744e6ea89df28a6b443c17e024"} Oct 30 13:20:21.451686 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.451670 4498 scope.go:122] "RemoveContainer" containerID="bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0" Oct 30 13:20:21.452033 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:21.452006 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0\": container with ID starting with bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0 not found: ID does not exist" containerID="bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0" Oct 30 13:20:21.452118 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.452044 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0"} err="failed to get container status \"bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0\": rpc error: code = NotFound desc = could not find container \"bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0\": container with ID starting with bc3d8fcd81c78fbdbd63f9db72e366ab707c27c63c28a605bcc6327426b860f0 not found: ID does not exist" Oct 30 13:20:21.452118 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.452061 4498 scope.go:122] "RemoveContainer" containerID="cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e" Oct 30 13:20:21.462845 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.462826 4498 scope.go:122] "RemoveContainer" containerID="cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e" Oct 30 13:20:21.463110 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:21.463091 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e\": container with ID starting with cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e not found: ID does not exist" containerID="cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e" Oct 30 13:20:21.463178 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.463116 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e"} err="failed to get container status \"cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e\": rpc error: code = NotFound desc = could not find container \"cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e\": container with ID starting with cb8bb737e4bb042591e6c8d1082ca77865f45bd80368ca2f6374dbf5f13af73e not found: ID does not exist" Oct 30 13:20:21.492876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.492851 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c"] Oct 30 13:20:21.500938 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.500918 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/premium-w3-d0a18c-kserve-6cf849d594-7cx7c"] Oct 30 13:20:21.548937 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.548872 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt"] Oct 30 13:20:21.555297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:21.555275 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-d0a18c/simulator-w3-d0a18c-kserve-6cf69cc895-zzxwt"] Oct 30 13:20:22.432237 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.432189 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk"] Oct 30 13:20:22.432489 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.432438 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" containerID="cri-o://c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c" gracePeriod=30 Oct 30 13:20:22.442629 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.442591 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt"] Oct 30 13:20:22.442886 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.442853 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" containerID="cri-o://ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a" gracePeriod=30 Oct 30 13:20:22.471359 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.471322 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg"] Oct 30 13:20:22.471629 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.471558 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" containerID="cri-o://5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff" gracePeriod=30 Oct 30 13:20:22.900714 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.900643 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" path="/var/lib/kubelet/pods/4d3a501f-1d4f-4abb-899f-2db484cb8d69/volumes" Oct 30 13:20:22.901053 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:22.901037 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" path="/var/lib/kubelet/pods/e21ce9c5-50df-42ce-8777-f956fa7a0b42/volumes" Oct 30 13:20:26.072673 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.072641 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:20:26.117740 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.117718 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:20:26.125533 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.125511 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:20:26.226669 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226634 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.226859 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226683 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.226859 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226715 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.226859 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226780 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.226859 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226813 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.226859 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226844 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226873 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226902 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226945 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.226973 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227003 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227036 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227098 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227150 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227184 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227235 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227260 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token\") pod \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\" (UID: \"1445ab99-2f20-4570-90bd-b7aed1b92ce0\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227302 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.227379 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227358 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227421 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227473 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227514 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227553 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227606 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket\") pod \"1df91573-184f-4975-b3cd-0daa9a552c12\" (UID: \"1df91573-184f-4975-b3cd-0daa9a552c12\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227635 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227669 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.228000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.227727 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token\") pod \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\" (UID: \"7da603be-e2cf-4373-9bbb-db864a0ba8cb\") " Oct 30 13:20:26.231280 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.230924 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.232684 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.231453 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.232893 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.232860 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.233528 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.233225 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.235063 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.234794 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:26.235063 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.234832 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "kube-api-access-7w8qn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:26.235063 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.235024 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.235333 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.235066 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "kube-api-access-fkql4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:26.235819 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.235573 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.235819 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.235576 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.236016 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.235830 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "kube-api-access-5bcwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:26.236175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.236146 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.236348 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.236152 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:26.236912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.236639 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:26.236912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.236886 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.237081 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.237051 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.237724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.237233 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.237724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.237406 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.237724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.237568 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.237724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.237643 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:26.238473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.237877 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:26.239844 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.239817 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:26.239944 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.239841 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.240338 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.240298 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo" pod "1445ab99-2f20-4570-90bd-b7aed1b92ce0" (UID: "1445ab99-2f20-4570-90bd-b7aed1b92ce0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:26.243315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.241106 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo" pod "1df91573-184f-4975-b3cd-0daa9a552c12" (UID: "1df91573-184f-4975-b3cd-0daa9a552c12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:26.243315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.241477 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:26.243315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.241502 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo" pod "7da603be-e2cf-4373-9bbb-db864a0ba8cb" (UID: "7da603be-e2cf-4373-9bbb-db864a0ba8cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330635 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330666 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1df91573-184f-4975-b3cd-0daa9a552c12-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330680 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bcwf\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-kube-api-access-5bcwf\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330690 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330700 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1df91573-184f-4975-b3cd-0daa9a552c12-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330707 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330715 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.330718 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330722 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330729 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330742 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330753 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330761 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330769 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330778 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330785 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330793 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w8qn\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-kube-api-access-7w8qn\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330801 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330809 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1df91573-184f-4975-b3cd-0daa9a552c12-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330818 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330830 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1df91573-184f-4975-b3cd-0daa9a552c12-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330838 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da603be-e2cf-4373-9bbb-db864a0ba8cb-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330845 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330853 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkql4\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-kube-api-access-fkql4\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330860 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330867 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330876 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1445ab99-2f20-4570-90bd-b7aed1b92ce0-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.331305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.330883 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1445ab99-2f20-4570-90bd-b7aed1b92ce0-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:26.473630 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.473591 4498 generic.go:356] "Generic (PLEG): container finished" podID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerID="f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8" exitCode=0 Oct 30 13:20:26.473823 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.473643 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" Oct 30 13:20:26.473823 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.473670 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" event={"ID":"1445ab99-2f20-4570-90bd-b7aed1b92ce0","Type":"ContainerDied","Data":"f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8"} Oct 30 13:20:26.473823 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.473759 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf" event={"ID":"1445ab99-2f20-4570-90bd-b7aed1b92ce0","Type":"ContainerDied","Data":"cfbb807a3d350de443a7538a0b07ddc6397245007ad7283e93b92434b56d1563"} Oct 30 13:20:26.473823 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.473785 4498 scope.go:122] "RemoveContainer" containerID="f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8" Oct 30 13:20:26.475274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.475250 4498 generic.go:356] "Generic (PLEG): container finished" podID="1df91573-184f-4975-b3cd-0daa9a552c12" containerID="ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817" exitCode=0 Oct 30 13:20:26.475401 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.475300 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" Oct 30 13:20:26.475401 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.475350 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" event={"ID":"1df91573-184f-4975-b3cd-0daa9a552c12","Type":"ContainerDied","Data":"ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817"} Oct 30 13:20:26.475517 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.475401 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g" event={"ID":"1df91573-184f-4975-b3cd-0daa9a552c12","Type":"ContainerDied","Data":"719850ce8da734a963455a821113773481e52eaf7a642400904642fd8dd74593"} Oct 30 13:20:26.479161 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.479140 4498 generic.go:356] "Generic (PLEG): container finished" podID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerID="edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7" exitCode=0 Oct 30 13:20:26.479281 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.479186 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" Oct 30 13:20:26.479281 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.479237 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" event={"ID":"7da603be-e2cf-4373-9bbb-db864a0ba8cb","Type":"ContainerDied","Data":"edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7"} Oct 30 13:20:26.479281 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.479276 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj" event={"ID":"7da603be-e2cf-4373-9bbb-db864a0ba8cb","Type":"ContainerDied","Data":"24231362dcefc3c2d7e0de6f15393722b356ae092f796933b709351f6714052f"} Oct 30 13:20:26.488744 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.487329 4498 scope.go:122] "RemoveContainer" containerID="f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8" Oct 30 13:20:26.488744 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:26.487753 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8\": container with ID starting with f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8 not found: ID does not exist" containerID="f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8" Oct 30 13:20:26.488744 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.487786 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8"} err="failed to get container status \"f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8\": rpc error: code = NotFound desc = could not find container \"f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8\": container with ID starting with f1320bb1b3d43f1ed33f00ddab35ec0062ead585c56e5b215551d2c2f40500d8 not found: ID does not exist" Oct 30 13:20:26.488744 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.487807 4498 scope.go:122] "RemoveContainer" containerID="ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817" Oct 30 13:20:26.497449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.497429 4498 scope.go:122] "RemoveContainer" containerID="ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817" Oct 30 13:20:26.497713 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:26.497697 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817\": container with ID starting with ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817 not found: ID does not exist" containerID="ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817" Oct 30 13:20:26.497758 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.497721 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817"} err="failed to get container status \"ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817\": rpc error: code = NotFound desc = could not find container \"ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817\": container with ID starting with ce90a539d90dc94af70167efa9b36ead9dcd2934230ebfa064784795fa9b1817 not found: ID does not exist" Oct 30 13:20:26.497758 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.497736 4498 scope.go:122] "RemoveContainer" containerID="edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7" Oct 30 13:20:26.505595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.505579 4498 scope.go:122] "RemoveContainer" containerID="edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7" Oct 30 13:20:26.505845 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:26.505828 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7\": container with ID starting with edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7 not found: ID does not exist" containerID="edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7" Oct 30 13:20:26.505908 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.505855 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7"} err="failed to get container status \"edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7\": rpc error: code = NotFound desc = could not find container \"edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7\": container with ID starting with edb7e2ba50390c398989d7a66365ca120847bb362ed1b4f6a729e1b1efd541b7 not found: ID does not exist" Oct 30 13:20:26.547832 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.547806 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g"] Oct 30 13:20:26.553888 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.553862 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-bbz2g"] Oct 30 13:20:26.587473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.587397 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf"] Oct 30 13:20:26.593610 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.593589 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-62vjf"] Oct 30 13:20:26.627158 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.627131 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj"] Oct 30 13:20:26.634228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.634192 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-05942d-openshift-default-5bdbff6f6c-54fnj"] Oct 30 13:20:26.902978 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.902908 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" path="/var/lib/kubelet/pods/1445ab99-2f20-4570-90bd-b7aed1b92ce0/volumes" Oct 30 13:20:26.903566 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.903549 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" path="/var/lib/kubelet/pods/1df91573-184f-4975-b3cd-0daa9a552c12/volumes" Oct 30 13:20:26.904120 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:26.904104 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" path="/var/lib/kubelet/pods/7da603be-e2cf-4373-9bbb-db864a0ba8cb/volumes" Oct 30 13:20:27.748136 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.748110 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:20:27.813751 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.813710 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:20:27.817565 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.817542 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:20:27.854883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.854854 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855062 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.854959 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855062 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.854983 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855062 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855014 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855062 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855048 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855185 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.855426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855267 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855426 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855414 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855509 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855552 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.855594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855586 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket\") pod \"d92a31db-d713-4977-83bb-734adfae331a\" (UID: \"d92a31db-d713-4977-83bb-734adfae331a\") " Oct 30 13:20:27.855730 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855596 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:27.855997 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.855973 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.856080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.856034 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.856080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.856056 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d92a31db-d713-4977-83bb-734adfae331a-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.856080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.856069 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.856265 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.856085 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.858013 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.857987 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:27.858823 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.858797 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.859494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.859466 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:27.867835 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.867657 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k" pod "d92a31db-d713-4977-83bb-734adfae331a" (UID: "d92a31db-d713-4977-83bb-734adfae331a"). InnerVolumeSpecName "kube-api-access-vpn6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:27.956671 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956640 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.956824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956706 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.956824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956748 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.956824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956778 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.956824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956802 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.957146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956861 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.957146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956900 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.957146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.956949 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.957146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957021 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.957146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957121 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.957146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957127 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:27.957682 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957420 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.957682 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957547 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.957682 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957590 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.957682 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957627 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.957682 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957645 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957699 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957750 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957753 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957811 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957881 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957911 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket\") pod \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\" (UID: \"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6\") " Oct 30 13:20:27.958089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.957947 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7\") pod \"857794d7-c674-48eb-b10e-91335ad04aa2\" (UID: \"857794d7-c674-48eb-b10e-91335ad04aa2\") " Oct 30 13:20:27.958699 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958658 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958699 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958688 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958703 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958717 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958729 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958740 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958752 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d92a31db-d713-4977-83bb-734adfae331a-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958765 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpn6k\" (UniqueName: \"kubernetes.io/projected/d92a31db-d713-4977-83bb-734adfae331a-kube-api-access-vpn6k\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958779 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/857794d7-c674-48eb-b10e-91335ad04aa2-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958792 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d92a31db-d713-4977-83bb-734adfae331a-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.958860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.958804 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:27.959333 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.959305 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.959636 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.959616 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.959760 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.959560 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.960313 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.960284 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:27.961287 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.960952 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:27.961287 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.961178 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.961287 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.961251 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.962297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.962268 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:27.962625 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.962556 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "kube-api-access-742v7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:27.962802 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.962779 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "kube-api-access-b85s6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:27.962884 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.962865 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy" pod "857794d7-c674-48eb-b10e-91335ad04aa2" (UID: "857794d7-c674-48eb-b10e-91335ad04aa2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:27.963021 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.963005 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:27.964128 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:27.964101 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy" pod "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" (UID: "4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:28.059907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059819 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.059907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059851 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.059907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059865 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-742v7\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-kube-api-access-742v7\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.059907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059878 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.059907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059890 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.059907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059901 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/857794d7-c674-48eb-b10e-91335ad04aa2-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059912 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059924 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/857794d7-c674-48eb-b10e-91335ad04aa2-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059933 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059944 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b85s6\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-kube-api-access-b85s6\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059956 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059967 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/857794d7-c674-48eb-b10e-91335ad04aa2-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.060227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.059978 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:28.496515 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.496478 4498 generic.go:356] "Generic (PLEG): container finished" podID="857794d7-c674-48eb-b10e-91335ad04aa2" containerID="5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff" exitCode=0 Oct 30 13:20:28.496695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.496556 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" Oct 30 13:20:28.496695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.496576 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" event={"ID":"857794d7-c674-48eb-b10e-91335ad04aa2","Type":"ContainerDied","Data":"5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff"} Oct 30 13:20:28.496695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.496669 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg" event={"ID":"857794d7-c674-48eb-b10e-91335ad04aa2","Type":"ContainerDied","Data":"87b5368dfb18a99c380c08fdc0262cc3baf6e21ca549435e2001453ea4b52445"} Oct 30 13:20:28.496695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.496691 4498 scope.go:122] "RemoveContainer" containerID="5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff" Oct 30 13:20:28.497902 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.497881 4498 generic.go:356] "Generic (PLEG): container finished" podID="d92a31db-d713-4977-83bb-734adfae331a" containerID="ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a" exitCode=0 Oct 30 13:20:28.497998 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.497966 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" event={"ID":"d92a31db-d713-4977-83bb-734adfae331a","Type":"ContainerDied","Data":"ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a"} Oct 30 13:20:28.498071 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.498005 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" event={"ID":"d92a31db-d713-4977-83bb-734adfae331a","Type":"ContainerDied","Data":"d6f35b8df1dc28f331998479c0e1a3532f3af939a083307c102f9da5e92e11a3"} Oct 30 13:20:28.498135 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.498091 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt" Oct 30 13:20:28.500623 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.500597 4498 generic.go:356] "Generic (PLEG): container finished" podID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerID="c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c" exitCode=0 Oct 30 13:20:28.500735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.500719 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" event={"ID":"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6","Type":"ContainerDied","Data":"c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c"} Oct 30 13:20:28.500792 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.500741 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" Oct 30 13:20:28.500792 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.500755 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk" event={"ID":"4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6","Type":"ContainerDied","Data":"185936e71901740ba0cefe39ce56fa44037fb3a9c9e21fd9ea91bf96704ee454"} Oct 30 13:20:28.508607 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.508536 4498 scope.go:122] "RemoveContainer" containerID="5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff" Oct 30 13:20:28.508820 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:28.508802 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff\": container with ID starting with 5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff not found: ID does not exist" containerID="5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff" Oct 30 13:20:28.508921 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.508830 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff"} err="failed to get container status \"5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff\": rpc error: code = NotFound desc = could not find container \"5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff\": container with ID starting with 5c92cf7fa2d64bc70cc2e6224a032ff00890864642748780778ff46ec13ef3ff not found: ID does not exist" Oct 30 13:20:28.508921 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.508852 4498 scope.go:122] "RemoveContainer" containerID="ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a" Oct 30 13:20:28.517740 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.517723 4498 scope.go:122] "RemoveContainer" containerID="ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a" Oct 30 13:20:28.517993 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:28.517977 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a\": container with ID starting with ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a not found: ID does not exist" containerID="ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a" Oct 30 13:20:28.518065 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.517998 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a"} err="failed to get container status \"ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a\": rpc error: code = NotFound desc = could not find container \"ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a\": container with ID starting with ff5e74ebf2eb100d9effc739ac4c356c07d03dc0869778c5233f84eb9709d47a not found: ID does not exist" Oct 30 13:20:28.518065 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.518011 4498 scope.go:122] "RemoveContainer" containerID="c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c" Oct 30 13:20:28.526507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.526483 4498 scope.go:122] "RemoveContainer" containerID="c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c" Oct 30 13:20:28.526749 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:28.526733 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c\": container with ID starting with c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c not found: ID does not exist" containerID="c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c" Oct 30 13:20:28.526826 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.526753 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c"} err="failed to get container status \"c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c\": rpc error: code = NotFound desc = could not find container \"c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c\": container with ID starting with c9717dea391fcd28cdcf23e6db8acb99232902f99a55e29baf7e94254edfca6c not found: ID does not exist" Oct 30 13:20:28.550456 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.550426 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk"] Oct 30 13:20:28.560649 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.560625 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-tldvk"] Oct 30 13:20:28.591499 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.591469 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg"] Oct 30 13:20:28.595736 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.595710 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-v7xjg"] Oct 30 13:20:28.634073 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.634048 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt"] Oct 30 13:20:28.643277 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.643253 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-031737-openshift-default-64b8f46f47-h8jjt"] Oct 30 13:20:28.899872 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.899846 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" path="/var/lib/kubelet/pods/4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6/volumes" Oct 30 13:20:28.900303 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.900280 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" path="/var/lib/kubelet/pods/857794d7-c674-48eb-b10e-91335ad04aa2/volumes" Oct 30 13:20:28.900669 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:28.900657 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d92a31db-d713-4977-83bb-734adfae331a" path="/var/lib/kubelet/pods/d92a31db-d713-4977-83bb-734adfae331a/volumes" Oct 30 13:20:29.776118 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:29.776083 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:20:37.143762 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.143726 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j"] Oct 30 13:20:37.144387 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.143978 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" podUID="738ebca1-c01b-40c9-be8d-110447b9f28a" containerName="maas-api" containerID="cri-o://955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61" gracePeriod=30 Oct 30 13:20:37.453181 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.453158 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:20:37.507809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.507260 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l\" (UniqueName: \"kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l\") pod \"738ebca1-c01b-40c9-be8d-110447b9f28a\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " Oct 30 13:20:37.507809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.507327 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls\") pod \"738ebca1-c01b-40c9-be8d-110447b9f28a\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " Oct 30 13:20:37.507809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.507376 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs\") pod \"738ebca1-c01b-40c9-be8d-110447b9f28a\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " Oct 30 13:20:37.507809 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.507549 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca\") pod \"738ebca1-c01b-40c9-be8d-110447b9f28a\" (UID: \"738ebca1-c01b-40c9-be8d-110447b9f28a\") " Oct 30 13:20:37.508420 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.508389 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca" pod "738ebca1-c01b-40c9-be8d-110447b9f28a" (UID: "738ebca1-c01b-40c9-be8d-110447b9f28a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:37.525129 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.524337 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l" pod "738ebca1-c01b-40c9-be8d-110447b9f28a" (UID: "738ebca1-c01b-40c9-be8d-110447b9f28a"). InnerVolumeSpecName "kube-api-access-wvp8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:37.531586 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.531528 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls" pod "738ebca1-c01b-40c9-be8d-110447b9f28a" (UID: "738ebca1-c01b-40c9-be8d-110447b9f28a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:20:37.532730 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.532701 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs" pod "738ebca1-c01b-40c9-be8d-110447b9f28a" (UID: "738ebca1-c01b-40c9-be8d-110447b9f28a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:20:37.599262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.597449 4498 generic.go:356] "Generic (PLEG): container finished" podID="738ebca1-c01b-40c9-be8d-110447b9f28a" containerID="955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61" exitCode=0 Oct 30 13:20:37.599262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.597554 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" event={"ID":"738ebca1-c01b-40c9-be8d-110447b9f28a","Type":"ContainerDied","Data":"955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61"} Oct 30 13:20:37.599262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.597603 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" event={"ID":"738ebca1-c01b-40c9-be8d-110447b9f28a","Type":"ContainerDied","Data":"a4329eae4f8038258ca24c8ca332c3d1b92b4f15c9bf223f7506251f1118ddad"} Oct 30 13:20:37.599262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.597631 4498 scope.go:122] "RemoveContainer" containerID="955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61" Oct 30 13:20:37.599262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.597807 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j" Oct 30 13:20:37.614481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.610163 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvp8l\" (UniqueName: \"kubernetes.io/projected/738ebca1-c01b-40c9-be8d-110447b9f28a-kube-api-access-wvp8l\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:37.614481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.610189 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:37.614481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.610224 4498 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/738ebca1-c01b-40c9-be8d-110447b9f28a-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:37.614481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.610236 4498 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/738ebca1-c01b-40c9-be8d-110447b9f28a-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:37.633571 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.633537 4498 scope.go:122] "RemoveContainer" containerID="955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61" Oct 30 13:20:37.633953 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:37.633931 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61\": container with ID starting with 955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61 not found: ID does not exist" containerID="955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61" Oct 30 13:20:37.634071 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.633964 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61"} err="failed to get container status \"955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61\": rpc error: code = NotFound desc = could not find container \"955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61\": container with ID starting with 955c8c7e28b933e660f1b0e275d62c30e17582e25b03c5fd5d0c0d17fa69ae61 not found: ID does not exist" Oct 30 13:20:37.662176 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.662132 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j"] Oct 30 13:20:37.670264 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:37.670233 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-d0a18c-648dc74444-pzq6j"] Oct 30 13:20:38.900860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:38.900831 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="738ebca1-c01b-40c9-be8d-110447b9f28a" path="/var/lib/kubelet/pods/738ebca1-c01b-40c9-be8d-110447b9f28a/volumes" Oct 30 13:20:48.797845 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:48.797810 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db"] Oct 30 13:20:48.798289 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:48.798004 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" containerID="cri-o://b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888" gracePeriod=30 Oct 30 13:20:48.814824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:48.814792 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j"] Oct 30 13:20:48.815066 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:48.815042 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" containerID="cri-o://6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89" gracePeriod=30 Oct 30 13:20:48.834048 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:48.833984 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld"] Oct 30 13:20:48.834280 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:48.834243 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" containerID="cri-o://98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d" gracePeriod=30 Oct 30 13:20:52.884146 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884105 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g"] Oct 30 13:20:52.884577 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884563 4498 cpu_manager.go:414] "containerMap: removing container" podUID="738ebca1-c01b-40c9-be8d-110447b9f28a" containerName="maas-api" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884578 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="738ebca1-c01b-40c9-be8d-110447b9f28a" containerName="maas-api" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884590 4498 cpu_manager.go:414] "containerMap: removing container" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884595 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884602 4498 cpu_manager.go:414] "containerMap: removing container" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884607 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884614 4498 cpu_manager.go:414] "containerMap: removing container" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" Oct 30 13:20:52.884616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884618 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884629 4498 cpu_manager.go:414] "containerMap: removing container" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884633 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884641 4498 cpu_manager.go:414] "containerMap: removing container" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884646 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884654 4498 cpu_manager.go:414] "containerMap: removing container" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884658 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884672 4498 cpu_manager.go:414] "containerMap: removing container" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884676 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884683 4498 cpu_manager.go:414] "containerMap: removing container" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884687 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884764 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="1445ab99-2f20-4570-90bd-b7aed1b92ce0" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884771 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="4fcd7d15-0b50-4950-ba7e-26bcbb8c9fc6" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884778 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="e21ce9c5-50df-42ce-8777-f956fa7a0b42" containerName="main" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884784 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="7da603be-e2cf-4373-9bbb-db864a0ba8cb" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884791 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="738ebca1-c01b-40c9-be8d-110447b9f28a" containerName="maas-api" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884796 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="857794d7-c674-48eb-b10e-91335ad04aa2" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884802 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="1df91573-184f-4975-b3cd-0daa9a552c12" containerName="istio-proxy" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884808 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d3a501f-1d4f-4abb-899f-2db484cb8d69" containerName="main" Oct 30 13:20:52.884816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.884814 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="d92a31db-d713-4977-83bb-734adfae331a" containerName="istio-proxy" Oct 30 13:20:52.889544 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.889529 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918407 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918378 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26gsl\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918423 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918617 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918699 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918665 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918816 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918799 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918857 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918835 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918900 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918860 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.918963 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.918941 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.919031 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.919003 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:52.928955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:52.928925 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g"] Oct 30 13:20:53.020084 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020047 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020084 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020085 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020147 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020167 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020188 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020335 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020390 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020413 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26gsl\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020451 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020784 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020620 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020862 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020831 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.020978 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.020959 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.021170 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.021013 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.021170 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.021168 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.022666 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.022645 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.022772 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.022753 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.042105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.042075 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.042242 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.042131 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26gsl\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl\") pod \"e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.203763 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.203723 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:53.527903 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.527823 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g"] Oct 30 13:20:53.531508 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:20:53.531482 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57de8d17_4a57_4d5f_a163_42dbc0c57daf.slice/crio-7425be316b37ea197d2f5d01ce4e1ce64828e42072f6a3ff3db9aea025b2c93c WatchSource:0}: Error finding container 7425be316b37ea197d2f5d01ce4e1ce64828e42072f6a3ff3db9aea025b2c93c: Status 404 returned error can't find the container with id 7425be316b37ea197d2f5d01ce4e1ce64828e42072f6a3ff3db9aea025b2c93c Oct 30 13:20:53.534348 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.534300 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:20:53.534437 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.534400 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:20:53.534480 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.534442 4498 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Oct 30 13:20:53.696665 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.696631 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" event={"ID":"57de8d17-4a57-4d5f-a163-42dbc0c57daf","Type":"ContainerStarted","Data":"2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23"} Oct 30 13:20:53.696844 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.696708 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" event={"ID":"57de8d17-4a57-4d5f-a163-42dbc0c57daf","Type":"ContainerStarted","Data":"7425be316b37ea197d2f5d01ce4e1ce64828e42072f6a3ff3db9aea025b2c93c"} Oct 30 13:20:53.745978 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:53.745915 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podStartSLOduration=1.745901272 podStartE2EDuration="1.745901272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:20:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:20:53.742790156 +0000 UTC m=+1428.973073290" watchObservedRunningTime="2026-10-30 13:20:53.745901272 +0000 UTC m=+1428.976184406" Oct 30 13:20:54.128934 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.128906 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:20:54.172267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.172240 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:20:54.186358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.186323 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:20:54.204009 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.203983 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:20:54.205526 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.205501 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:20:54.205691 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.205556 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:20:54.238161 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238123 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238181 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238233 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.238375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238260 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.238375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238318 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238375 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238346 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.238659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238387 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.238659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238418 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238488 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238558 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.238659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238587 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.238659 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238631 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238682 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238714 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238788 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238841 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238871 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238924 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.238982 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.238961 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.239358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239028 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.239358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239123 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.239358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239170 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.239358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239244 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.239358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239314 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.239358 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239345 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token\") pod \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\" (UID: \"2b2e44f6-ba31-4d19-9c52-5bc30252fc56\") " Oct 30 13:20:54.239656 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239412 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token\") pod \"dbcfee04-6fa6-474b-9043-5ce48967c996\" (UID: \"dbcfee04-6fa6-474b-9043-5ce48967c996\") " Oct 30 13:20:54.239656 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.239495 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket\") pod \"88d7199a-e822-4f39-9880-fedafd700532\" (UID: \"88d7199a-e822-4f39-9880-fedafd700532\") " Oct 30 13:20:54.240428 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.240399 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.241183 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.240865 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.241183 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.240906 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.241367 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.241232 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.241367 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.241254 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.242135 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.241563 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.242448 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.246522 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.246569 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.246650 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.246764 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.246931 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.246938 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.247067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.247029 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.247875 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.247625 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.255416 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.255367 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.255416 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.255406 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "kube-api-access-4cd7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:54.255999 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.255746 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:54.255999 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.255844 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:54.255999 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.255903 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.255999 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.255951 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:20:54.256462 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.256431 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token" pod "dbcfee04-6fa6-474b-9043-5ce48967c996" (UID: "dbcfee04-6fa6-474b-9043-5ce48967c996"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:54.256724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.256705 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:54.257070 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.257042 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "kube-api-access-knr6l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:54.257174 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.257147 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token" pod "2b2e44f6-ba31-4d19-9c52-5bc30252fc56" (UID: "2b2e44f6-ba31-4d19-9c52-5bc30252fc56"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:54.258791 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.257250 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:20:54.258791 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.258723 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq" pod "88d7199a-e822-4f39-9880-fedafd700532" (UID: "88d7199a-e822-4f39-9880-fedafd700532"). InnerVolumeSpecName "kube-api-access-jwzsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354004 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354044 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354059 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354073 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354088 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354102 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knr6l\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-kube-api-access-knr6l\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354118 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354131 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354143 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354156 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwzsq\" (UniqueName: \"kubernetes.io/projected/88d7199a-e822-4f39-9880-fedafd700532-kube-api-access-jwzsq\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354170 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354182 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354214 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354227 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354240 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354253 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354266 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354278 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354290 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354303 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbcfee04-6fa6-474b-9043-5ce48967c996-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354325 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88d7199a-e822-4f39-9880-fedafd700532-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354339 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b2e44f6-ba31-4d19-9c52-5bc30252fc56-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354353 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cd7s\" (UniqueName: \"kubernetes.io/projected/dbcfee04-6fa6-474b-9043-5ce48967c996-kube-api-access-4cd7s\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354366 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88d7199a-e822-4f39-9880-fedafd700532-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354379 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88d7199a-e822-4f39-9880-fedafd700532-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354391 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbcfee04-6fa6-474b-9043-5ce48967c996-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.357283 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.354403 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbcfee04-6fa6-474b-9043-5ce48967c996-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:20:54.703050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.703019 4498 generic.go:356] "Generic (PLEG): container finished" podID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerID="b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888" exitCode=0 Oct 30 13:20:54.703231 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.703059 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" Oct 30 13:20:54.703231 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.703105 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" event={"ID":"dbcfee04-6fa6-474b-9043-5ce48967c996","Type":"ContainerDied","Data":"b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888"} Oct 30 13:20:54.703231 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.703160 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db" event={"ID":"dbcfee04-6fa6-474b-9043-5ce48967c996","Type":"ContainerDied","Data":"f8f0b2f811ef2d07327ca74fda6666231ebbd613564ab99ced7ec9ea01e994d6"} Oct 30 13:20:54.703231 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.703184 4498 scope.go:122] "RemoveContainer" containerID="b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888" Oct 30 13:20:54.704871 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.704847 4498 generic.go:356] "Generic (PLEG): container finished" podID="88d7199a-e822-4f39-9880-fedafd700532" containerID="98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d" exitCode=0 Oct 30 13:20:54.704965 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.704890 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" Oct 30 13:20:54.705009 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.704938 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" event={"ID":"88d7199a-e822-4f39-9880-fedafd700532","Type":"ContainerDied","Data":"98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d"} Oct 30 13:20:54.705053 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.705010 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld" event={"ID":"88d7199a-e822-4f39-9880-fedafd700532","Type":"ContainerDied","Data":"b015201375e159570971dc21da67cf6dec908f05105b5fd49f59c3b21816377c"} Oct 30 13:20:54.706625 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.706602 4498 generic.go:356] "Generic (PLEG): container finished" podID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerID="6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89" exitCode=0 Oct 30 13:20:54.706746 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.706643 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" Oct 30 13:20:54.706746 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.706705 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" event={"ID":"2b2e44f6-ba31-4d19-9c52-5bc30252fc56","Type":"ContainerDied","Data":"6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89"} Oct 30 13:20:54.706851 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.706755 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j" event={"ID":"2b2e44f6-ba31-4d19-9c52-5bc30252fc56","Type":"ContainerDied","Data":"e2b524f1a25156c65305db4e94abefc5cc1070f07d9c1ad0d5a6f3c413ea78af"} Oct 30 13:20:54.713531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.713510 4498 scope.go:122] "RemoveContainer" containerID="b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888" Oct 30 13:20:54.713896 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:54.713854 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888\": container with ID starting with b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888 not found: ID does not exist" containerID="b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888" Oct 30 13:20:54.713896 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.713888 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888"} err="failed to get container status \"b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888\": rpc error: code = NotFound desc = could not find container \"b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888\": container with ID starting with b74fe2a1ba30cbf0bcedf3d3cdbd61571018b3076a22f3fd84ad146a3011c888 not found: ID does not exist" Oct 30 13:20:54.714063 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.713907 4498 scope.go:122] "RemoveContainer" containerID="98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d" Oct 30 13:20:54.723892 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.723873 4498 scope.go:122] "RemoveContainer" containerID="98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d" Oct 30 13:20:54.724178 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:54.724159 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d\": container with ID starting with 98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d not found: ID does not exist" containerID="98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d" Oct 30 13:20:54.724280 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.724191 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d"} err="failed to get container status \"98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d\": rpc error: code = NotFound desc = could not find container \"98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d\": container with ID starting with 98696b38b667871d11c10f34b6e7e891e2f1a7590d2f4566f05f4ff4b5c88c3d not found: ID does not exist" Oct 30 13:20:54.724280 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.724228 4498 scope.go:122] "RemoveContainer" containerID="6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89" Oct 30 13:20:54.750687 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.749661 4498 scope.go:122] "RemoveContainer" containerID="6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89" Oct 30 13:20:54.757449 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:54.757362 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89\": container with ID starting with 6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89 not found: ID does not exist" containerID="6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89" Oct 30 13:20:54.757449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.757407 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89"} err="failed to get container status \"6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89\": rpc error: code = NotFound desc = could not find container \"6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89\": container with ID starting with 6727fcadcb98e1c5178c27aa70430cc228d2e86ef93d811cf7c32546f1a9db89 not found: ID does not exist" Oct 30 13:20:54.795063 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.795031 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db"] Oct 30 13:20:54.805685 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.805654 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-564db"] Oct 30 13:20:54.863221 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.855061 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld"] Oct 30 13:20:54.866151 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.866109 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-9lkld"] Oct 30 13:20:54.900429 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.900401 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88d7199a-e822-4f39-9880-fedafd700532" path="/var/lib/kubelet/pods/88d7199a-e822-4f39-9880-fedafd700532/volumes" Oct 30 13:20:54.900927 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.900907 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" path="/var/lib/kubelet/pods/dbcfee04-6fa6-474b-9043-5ce48967c996/volumes" Oct 30 13:20:54.901247 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.901230 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j"] Oct 30 13:20:54.908334 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:54.908308 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-d0a18c-openshift-default-547d57db97-89k2j"] Oct 30 13:20:55.191993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:55.191962 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw"] Oct 30 13:20:55.204444 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:55.204411 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:20:55.204621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:55.204456 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:20:55.204621 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:55.204608 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg"] Oct 30 13:20:55.217103 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:55.217074 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk"] Oct 30 13:20:56.204613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:56.204580 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:20:56.205018 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:56.204630 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:20:56.903136 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:56.903104 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" path="/var/lib/kubelet/pods/2b2e44f6-ba31-4d19-9c52-5bc30252fc56/volumes" Oct 30 13:20:57.204350 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:57.204320 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:20:57.204508 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:57.204374 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:20:58.204063 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:58.204024 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:20:58.204493 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:58.204089 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:20:59.204193 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:59.204154 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:20:59.204588 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:20:59.204252 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:20:59.782261 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:20:59.782173 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:21:00.205004 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:00.204967 4498 patch_prober.go:29] interesting pod/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body= Oct 30 13:21:00.205423 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:00.205040 4498 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" Oct 30 13:21:01.281576 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:01.281539 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:21:01.283019 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:01.282998 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:21:01.284285 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:01.284263 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:21:10.213054 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.213018 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" containerID="cri-o://220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193" gracePeriod=45 Oct 30 13:21:10.226431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.226376 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" containerID="cri-o://04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382" gracePeriod=45 Oct 30 13:21:10.263524 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.263483 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" containerID="cri-o://be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9" gracePeriod=45 Oct 30 13:21:10.562535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.562176 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:21:10.611352 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.610825 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:21:10.619387 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.619365 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:21:10.634092 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634060 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm\") pod \"4b5b88be-8533-461c-afae-ba189119a4f7\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " Oct 30 13:21:10.634739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634137 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir\") pod \"4b5b88be-8533-461c-afae-ba189119a4f7\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " Oct 30 13:21:10.634739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634617 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir" pod "4b5b88be-8533-461c-afae-ba189119a4f7" (UID: "4b5b88be-8533-461c-afae-ba189119a4f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.634739 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634682 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache\") pod \"4b5b88be-8533-461c-afae-ba189119a4f7\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " Oct 30 13:21:10.634974 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634772 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs\") pod \"4b5b88be-8533-461c-afae-ba189119a4f7\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " Oct 30 13:21:10.634974 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634861 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache" pod "4b5b88be-8533-461c-afae-ba189119a4f7" (UID: "4b5b88be-8533-461c-afae-ba189119a4f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.634974 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634872 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home\") pod \"4b5b88be-8533-461c-afae-ba189119a4f7\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " Oct 30 13:21:10.634974 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.634950 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp\" (UniqueName: \"kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp\") pod \"4b5b88be-8533-461c-afae-ba189119a4f7\" (UID: \"4b5b88be-8533-461c-afae-ba189119a4f7\") " Oct 30 13:21:10.635178 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.635072 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home" pod "4b5b88be-8533-461c-afae-ba189119a4f7" (UID: "4b5b88be-8533-461c-afae-ba189119a4f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.635754 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.635726 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.635876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.635759 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.635876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.635773 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.637925 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.637891 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp" pod "4b5b88be-8533-461c-afae-ba189119a4f7" (UID: "4b5b88be-8533-461c-afae-ba189119a4f7"). InnerVolumeSpecName "kube-api-access-c7qzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:10.638652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.638610 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm" pod "4b5b88be-8533-461c-afae-ba189119a4f7" (UID: "4b5b88be-8533-461c-afae-ba189119a4f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.639535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.639509 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs" pod "4b5b88be-8533-461c-afae-ba189119a4f7" (UID: "4b5b88be-8533-461c-afae-ba189119a4f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:10.736829 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.736800 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm\") pod \"3ec0beab-649b-4134-a2b5-55b028f40172\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " Oct 30 13:21:10.737023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.736854 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs\" (UniqueName: \"kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs\") pod \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " Oct 30 13:21:10.737023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.736888 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m\" (UniqueName: \"kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m\") pod \"3ec0beab-649b-4134-a2b5-55b028f40172\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " Oct 30 13:21:10.737023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.736916 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir\") pod \"3ec0beab-649b-4134-a2b5-55b028f40172\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " Oct 30 13:21:10.737023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.736949 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home\") pod \"3ec0beab-649b-4134-a2b5-55b028f40172\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " Oct 30 13:21:10.737023 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.736986 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm\") pod \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " Oct 30 13:21:10.737332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737029 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs\") pod \"3ec0beab-649b-4134-a2b5-55b028f40172\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " Oct 30 13:21:10.737332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737084 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home\") pod \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " Oct 30 13:21:10.737332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737109 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir\") pod \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " Oct 30 13:21:10.737332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737140 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5\" (UniqueName: \"kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5\") pod \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " Oct 30 13:21:10.737332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737227 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir" pod "3ec0beab-649b-4134-a2b5-55b028f40172" (UID: "3ec0beab-649b-4134-a2b5-55b028f40172"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.737332 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737292 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache\") pod \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\" (UID: \"cb45ebbb-cffc-4221-ae94-9ede32f187f4\") " Oct 30 13:21:10.737717 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737361 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache\") pod \"3ec0beab-649b-4134-a2b5-55b028f40172\" (UID: \"3ec0beab-649b-4134-a2b5-55b028f40172\") " Oct 30 13:21:10.737717 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737430 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home" pod "cb45ebbb-cffc-4221-ae94-9ede32f187f4" (UID: "cb45ebbb-cffc-4221-ae94-9ede32f187f4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.737883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737809 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b5b88be-8533-461c-afae-ba189119a4f7-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.737883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737831 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.737883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737844 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.737883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737858 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b5b88be-8533-461c-afae-ba189119a4f7-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.737883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737872 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7qzp\" (UniqueName: \"kubernetes.io/projected/4b5b88be-8533-461c-afae-ba189119a4f7-kube-api-access-c7qzp\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.737883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.737880 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache" pod "cb45ebbb-cffc-4221-ae94-9ede32f187f4" (UID: "cb45ebbb-cffc-4221-ae94-9ede32f187f4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.738330 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.738035 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache" pod "3ec0beab-649b-4134-a2b5-55b028f40172" (UID: "3ec0beab-649b-4134-a2b5-55b028f40172"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.738330 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.738049 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home" pod "3ec0beab-649b-4134-a2b5-55b028f40172" (UID: "3ec0beab-649b-4134-a2b5-55b028f40172"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.738330 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.738322 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir" pod "cb45ebbb-cffc-4221-ae94-9ede32f187f4" (UID: "cb45ebbb-cffc-4221-ae94-9ede32f187f4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.741069 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.741043 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm" pod "3ec0beab-649b-4134-a2b5-55b028f40172" (UID: "3ec0beab-649b-4134-a2b5-55b028f40172"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.741224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.741090 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs" pod "cb45ebbb-cffc-4221-ae94-9ede32f187f4" (UID: "cb45ebbb-cffc-4221-ae94-9ede32f187f4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:10.741300 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.741265 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m" pod "3ec0beab-649b-4134-a2b5-55b028f40172" (UID: "3ec0beab-649b-4134-a2b5-55b028f40172"). InnerVolumeSpecName "kube-api-access-zj68m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:10.741409 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.741382 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm" pod "cb45ebbb-cffc-4221-ae94-9ede32f187f4" (UID: "cb45ebbb-cffc-4221-ae94-9ede32f187f4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:10.741638 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.741615 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5" pod "cb45ebbb-cffc-4221-ae94-9ede32f187f4" (UID: "cb45ebbb-cffc-4221-ae94-9ede32f187f4"). InnerVolumeSpecName "kube-api-access-m2vg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:10.742031 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.742013 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs" pod "3ec0beab-649b-4134-a2b5-55b028f40172" (UID: "3ec0beab-649b-4134-a2b5-55b028f40172"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:10.807665 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.807572 4498 generic.go:356] "Generic (PLEG): container finished" podID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerID="220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193" exitCode=0 Oct 30 13:21:10.807665 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.807630 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" Oct 30 13:21:10.807913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.807671 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" event={"ID":"cb45ebbb-cffc-4221-ae94-9ede32f187f4","Type":"ContainerDied","Data":"220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193"} Oct 30 13:21:10.807913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.807720 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw" event={"ID":"cb45ebbb-cffc-4221-ae94-9ede32f187f4","Type":"ContainerDied","Data":"64684c2c939d2e8b4cc7270558f1da51b7c488d6f90f7fa52bfe24cfc42033e4"} Oct 30 13:21:10.807913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.807739 4498 scope.go:122] "RemoveContainer" containerID="220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193" Oct 30 13:21:10.809182 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.809160 4498 generic.go:356] "Generic (PLEG): container finished" podID="3ec0beab-649b-4134-a2b5-55b028f40172" containerID="be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9" exitCode=0 Oct 30 13:21:10.809326 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.809261 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" Oct 30 13:21:10.809326 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.809283 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" event={"ID":"3ec0beab-649b-4134-a2b5-55b028f40172","Type":"ContainerDied","Data":"be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9"} Oct 30 13:21:10.809326 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.809313 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk" event={"ID":"3ec0beab-649b-4134-a2b5-55b028f40172","Type":"ContainerDied","Data":"ff773a12d57635eccf7126bd0fbf20f47760e2f13bb63628b5ada933422d0b83"} Oct 30 13:21:10.810800 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.810781 4498 generic.go:356] "Generic (PLEG): container finished" podID="4b5b88be-8533-461c-afae-ba189119a4f7" containerID="04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382" exitCode=0 Oct 30 13:21:10.810912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.810811 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" event={"ID":"4b5b88be-8533-461c-afae-ba189119a4f7","Type":"ContainerDied","Data":"04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382"} Oct 30 13:21:10.810912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.810833 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" Oct 30 13:21:10.810912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.810853 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg" event={"ID":"4b5b88be-8533-461c-afae-ba189119a4f7","Type":"ContainerDied","Data":"9c1cc53e74431627e838304203907c58529c19ec0dbddb4606f36db0632ac322"} Oct 30 13:21:10.818631 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.818611 4498 scope.go:122] "RemoveContainer" containerID="220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193" Oct 30 13:21:10.819020 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:10.818994 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193\": container with ID starting with 220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193 not found: ID does not exist" containerID="220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193" Oct 30 13:21:10.819115 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.819034 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193"} err="failed to get container status \"220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193\": rpc error: code = NotFound desc = could not find container \"220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193\": container with ID starting with 220a118c32cc1405d26189fc595940983378d30f1614fd5bf76a61e871d6a193 not found: ID does not exist" Oct 30 13:21:10.819115 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.819059 4498 scope.go:122] "RemoveContainer" containerID="be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9" Oct 30 13:21:10.833029 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.833007 4498 scope.go:122] "RemoveContainer" containerID="be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9" Oct 30 13:21:10.833673 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:10.833642 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9\": container with ID starting with be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9 not found: ID does not exist" containerID="be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9" Oct 30 13:21:10.833821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.833681 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9"} err="failed to get container status \"be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9\": rpc error: code = NotFound desc = could not find container \"be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9\": container with ID starting with be1dbebadae0be7f44d5db2d2b77ff0a21188ec8cbe03bccee4ac929b64d15a9 not found: ID does not exist" Oct 30 13:21:10.833821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.833705 4498 scope.go:122] "RemoveContainer" containerID="04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382" Oct 30 13:21:10.838980 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.838963 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.838986 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.838998 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ec0beab-649b-4134-a2b5-55b028f40172-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839011 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839024 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2vg5\" (UniqueName: \"kubernetes.io/projected/cb45ebbb-cffc-4221-ae94-9ede32f187f4-kube-api-access-m2vg5\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839037 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb45ebbb-cffc-4221-ae94-9ede32f187f4-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839050 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839060 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ec0beab-649b-4134-a2b5-55b028f40172-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839071 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb45ebbb-cffc-4221-ae94-9ede32f187f4-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.839114 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.839083 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj68m\" (UniqueName: \"kubernetes.io/projected/3ec0beab-649b-4134-a2b5-55b028f40172-kube-api-access-zj68m\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:10.843882 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.843858 4498 scope.go:122] "RemoveContainer" containerID="04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382" Oct 30 13:21:10.844268 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:10.844244 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382\": container with ID starting with 04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382 not found: ID does not exist" containerID="04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382" Oct 30 13:21:10.844359 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.844280 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382"} err="failed to get container status \"04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382\": rpc error: code = NotFound desc = could not find container \"04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382\": container with ID starting with 04ce73cff1fc9f41d7a01bbf1dad1f0b795f1bdce9dfac6ab4d501d343fc1382 not found: ID does not exist" Oct 30 13:21:10.884346 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.884319 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw"] Oct 30 13:21:10.890854 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.890829 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/distinct-w4-88f6a4-kserve-6b6c864fb4-fdnjw"] Oct 30 13:21:10.899970 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.899939 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" path="/var/lib/kubelet/pods/cb45ebbb-cffc-4221-ae94-9ede32f187f4/volumes" Oct 30 13:21:10.922701 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.922673 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg"] Oct 30 13:21:10.931147 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.926583 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/premium-w4-88f6a4-kserve-85cdf6665c-286dg"] Oct 30 13:21:10.955988 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.955959 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk"] Oct 30 13:21:10.963106 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:10.963083 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-88f6a4/simulator-w4-88f6a4-kserve-6488dddf44-qjfnk"] Oct 30 13:21:11.693960 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:11.693928 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm"] Oct 30 13:21:11.694499 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:11.694259 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" podUID="a9ec3890-f9fc-48d4-802b-3ea67d1a3408" containerName="maas-api" containerID="cri-o://788f69e56d71aedab6296236a235351ff9a2de8d3006d149429fd8c1039e7187" gracePeriod=30 Oct 30 13:21:11.821632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:11.821598 4498 generic.go:356] "Generic (PLEG): container finished" podID="a9ec3890-f9fc-48d4-802b-3ea67d1a3408" containerID="788f69e56d71aedab6296236a235351ff9a2de8d3006d149429fd8c1039e7187" exitCode=0 Oct 30 13:21:11.821807 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:11.821704 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" event={"ID":"a9ec3890-f9fc-48d4-802b-3ea67d1a3408","Type":"ContainerDied","Data":"788f69e56d71aedab6296236a235351ff9a2de8d3006d149429fd8c1039e7187"} Oct 30 13:21:12.025647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.025613 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:21:12.157920 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.157371 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls\") pod \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " Oct 30 13:21:12.157920 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.157471 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca\") pod \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " Oct 30 13:21:12.157920 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.157716 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs\") pod \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " Oct 30 13:21:12.157920 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.157921 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw\" (UniqueName: \"kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw\") pod \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\" (UID: \"a9ec3890-f9fc-48d4-802b-3ea67d1a3408\") " Oct 30 13:21:12.158319 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.158157 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca" pod "a9ec3890-f9fc-48d4-802b-3ea67d1a3408" (UID: "a9ec3890-f9fc-48d4-802b-3ea67d1a3408"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:12.158394 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.158350 4498 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:12.161289 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.161260 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls" pod "a9ec3890-f9fc-48d4-802b-3ea67d1a3408" (UID: "a9ec3890-f9fc-48d4-802b-3ea67d1a3408"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:12.161425 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.161387 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw" pod "a9ec3890-f9fc-48d4-802b-3ea67d1a3408" (UID: "a9ec3890-f9fc-48d4-802b-3ea67d1a3408"). InnerVolumeSpecName "kube-api-access-hv4zw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:12.163465 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.163402 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs" pod "a9ec3890-f9fc-48d4-802b-3ea67d1a3408" (UID: "a9ec3890-f9fc-48d4-802b-3ea67d1a3408"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:12.259080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.259009 4498 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:12.259080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.259039 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv4zw\" (UniqueName: \"kubernetes.io/projected/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-kube-api-access-hv4zw\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:12.259080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.259048 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9ec3890-f9fc-48d4-802b-3ea67d1a3408-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:12.850558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.847718 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" event={"ID":"a9ec3890-f9fc-48d4-802b-3ea67d1a3408","Type":"ContainerDied","Data":"e6e61c08fc5c32516a352afb0da9cbcc6090394dad6d0439e18cc584bff8256e"} Oct 30 13:21:12.850558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.847792 4498 scope.go:122] "RemoveContainer" containerID="788f69e56d71aedab6296236a235351ff9a2de8d3006d149429fd8c1039e7187" Oct 30 13:21:12.850558 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.847934 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm" Oct 30 13:21:12.901276 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.901190 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" path="/var/lib/kubelet/pods/3ec0beab-649b-4134-a2b5-55b028f40172/volumes" Oct 30 13:21:12.901723 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.901706 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" path="/var/lib/kubelet/pods/4b5b88be-8533-461c-afae-ba189119a4f7/volumes" Oct 30 13:21:12.910183 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.910151 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm"] Oct 30 13:21:12.925576 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:12.925537 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-f76c09-5dcc6bb585-4nzzm"] Oct 30 13:21:14.899227 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:14.899158 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a9ec3890-f9fc-48d4-802b-3ea67d1a3408" path="/var/lib/kubelet/pods/a9ec3890-f9fc-48d4-802b-3ea67d1a3408/volumes" Oct 30 13:21:15.620476 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.620441 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh"] Oct 30 13:21:15.620738 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.620705 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" podUID="a5360e13-b776-4843-82f7-4ba122aada7f" containerName="maas-api" containerID="cri-o://ced365b1096b7cd863ddd01bfa5b9b0c4d086ee8ae3580f01783c0d97ab719fb" gracePeriod=30 Oct 30 13:21:15.899089 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.899063 4498 generic.go:356] "Generic (PLEG): container finished" podID="a5360e13-b776-4843-82f7-4ba122aada7f" containerID="ced365b1096b7cd863ddd01bfa5b9b0c4d086ee8ae3580f01783c0d97ab719fb" exitCode=0 Oct 30 13:21:15.899290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.899123 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" event={"ID":"a5360e13-b776-4843-82f7-4ba122aada7f","Type":"ContainerDied","Data":"ced365b1096b7cd863ddd01bfa5b9b0c4d086ee8ae3580f01783c0d97ab719fb"} Oct 30 13:21:15.899290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.899152 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" event={"ID":"a5360e13-b776-4843-82f7-4ba122aada7f","Type":"ContainerDied","Data":"699d4d088ac26d48c4d0405a17322a058e4bde4302322de2c019a3152c41e15b"} Oct 30 13:21:15.899290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.899166 4498 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="699d4d088ac26d48c4d0405a17322a058e4bde4302322de2c019a3152c41e15b" Oct 30 13:21:15.908687 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:15.908410 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:21:16.026246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.019616 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs\") pod \"a5360e13-b776-4843-82f7-4ba122aada7f\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " Oct 30 13:21:16.026246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.019708 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca\") pod \"a5360e13-b776-4843-82f7-4ba122aada7f\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " Oct 30 13:21:16.026246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.019750 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\") pod \"a5360e13-b776-4843-82f7-4ba122aada7f\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " Oct 30 13:21:16.026246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.019852 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v\" (UniqueName: \"kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v\") pod \"a5360e13-b776-4843-82f7-4ba122aada7f\" (UID: \"a5360e13-b776-4843-82f7-4ba122aada7f\") " Oct 30 13:21:16.026246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.023237 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca" pod "a5360e13-b776-4843-82f7-4ba122aada7f" (UID: "a5360e13-b776-4843-82f7-4ba122aada7f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:16.026246 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.025970 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs" pod "a5360e13-b776-4843-82f7-4ba122aada7f" (UID: "a5360e13-b776-4843-82f7-4ba122aada7f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:16.027906 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.027870 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls" pod "a5360e13-b776-4843-82f7-4ba122aada7f" (UID: "a5360e13-b776-4843-82f7-4ba122aada7f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:16.028494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.028462 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v" pod "a5360e13-b776-4843-82f7-4ba122aada7f" (UID: "a5360e13-b776-4843-82f7-4ba122aada7f"). InnerVolumeSpecName "kube-api-access-57f5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:16.121639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.121608 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57f5v\" (UniqueName: \"kubernetes.io/projected/a5360e13-b776-4843-82f7-4ba122aada7f-kube-api-access-57f5v\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:16.121639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.121635 4498 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:16.121639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.121646 4498 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5360e13-b776-4843-82f7-4ba122aada7f-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:16.121878 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.121655 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5360e13-b776-4843-82f7-4ba122aada7f-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:16.904087 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.904044 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh" Oct 30 13:21:16.959147 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.959113 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh"] Oct 30 13:21:16.968717 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:16.968690 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-88f6a4-546f676cc7-8kswh"] Oct 30 13:21:18.899107 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:18.899075 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5360e13-b776-4843-82f7-4ba122aada7f" path="/var/lib/kubelet/pods/a5360e13-b776-4843-82f7-4ba122aada7f/volumes" Oct 30 13:21:20.991574 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:20.991539 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9"] Oct 30 13:21:20.991998 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:20.991798 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" containerID="cri-o://7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432" gracePeriod=30 Oct 30 13:21:21.002588 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:21.002557 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx"] Oct 30 13:21:21.002967 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:21.002926 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" containerID="cri-o://0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289" gracePeriod=30 Oct 30 13:21:21.038615 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:21.038587 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg"] Oct 30 13:21:21.038834 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:21.038813 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" containerID="cri-o://1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808" gracePeriod=30 Oct 30 13:21:23.549760 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:23.549710 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 13:21:23.550139 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:23.549796 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 13:21:24.443421 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:24.443383 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8"] Oct 30 13:21:24.532600 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:24.532561 4498 patch_prober.go:29] interesting pod/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 13:21:24.532752 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:24.532643 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 13:21:26.284297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.284270 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:21:26.327189 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.327165 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:21:26.358288 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.358259 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:21:26.422693 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.422658 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.422693 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.422707 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.422766 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.422803 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.422843 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423235 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423030 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423235 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423095 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423235 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423135 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423235 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423157 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy\") pod \"89d4357e-e83f-4fff-a979-8a15e767a0ab\" (UID: \"89d4357e-e83f-4fff-a979-8a15e767a0ab\") " Oct 30 13:21:26.423860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423704 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.423860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423807 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.423860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423823 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.423860 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.423838 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.424566 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.424382 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:26.425751 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.425731 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "kube-api-access-9gwvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:26.425852 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.425790 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:26.426352 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.426317 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:21:26.426442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.426405 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy" pod "89d4357e-e83f-4fff-a979-8a15e767a0ab" (UID: "89d4357e-e83f-4fff-a979-8a15e767a0ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.524639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524571 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.524639 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524626 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.524861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524658 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.524861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524694 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.524861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524736 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.524861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524799 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.524861 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524846 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524872 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524906 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524938 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524942 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524986 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.524976 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.525132 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525075 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525133 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525136 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525134 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525172 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525176 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525254 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525294 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs\") pod \"dab13cf0-4b26-4a77-93fb-18ccfee54324\" (UID: \"dab13cf0-4b26-4a77-93fb-18ccfee54324\") " Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525471 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525488 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.525531 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525501 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy\") pod \"128c0a65-3a51-4317-8522-9e935d474671\" (UID: \"128c0a65-3a51-4317-8522-9e935d474671\") " Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525681 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525812 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525868 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525887 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525905 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525918 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525930 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525941 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525952 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/128c0a65-3a51-4317-8522-9e935d474671-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525965 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525978 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d4357e-e83f-4fff-a979-8a15e767a0ab-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525989 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.525994 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526016 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526031 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dab13cf0-4b26-4a77-93fb-18ccfee54324-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526046 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d4357e-e83f-4fff-a979-8a15e767a0ab-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526062 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gwvj\" (UniqueName: \"kubernetes.io/projected/89d4357e-e83f-4fff-a979-8a15e767a0ab-kube-api-access-9gwvj\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.526078 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526075 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.527249 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526091 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d4357e-e83f-4fff-a979-8a15e767a0ab-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.527249 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.526327 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.527955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.527918 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "kube-api-access-ksstp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:26.528248 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.528215 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.528359 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.528340 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "kube-api-access-mv95m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:26.528428 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.528387 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:21:26.528483 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.528434 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token" pod "dab13cf0-4b26-4a77-93fb-18ccfee54324" (UID: "dab13cf0-4b26-4a77-93fb-18ccfee54324"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:26.528483 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.528461 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:21:26.528554 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.528522 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:26.529145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.529112 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy" pod "128c0a65-3a51-4317-8522-9e935d474671" (UID: "128c0a65-3a51-4317-8522-9e935d474671"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:26.626913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626887 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.626913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626912 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.626913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626921 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626931 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/128c0a65-3a51-4317-8522-9e935d474671-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626940 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv95m\" (UniqueName: \"kubernetes.io/projected/128c0a65-3a51-4317-8522-9e935d474671-kube-api-access-mv95m\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626951 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626963 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626972 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dab13cf0-4b26-4a77-93fb-18ccfee54324-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626980 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626987 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/128c0a65-3a51-4317-8522-9e935d474671-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.627141 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.626994 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksstp\" (UniqueName: \"kubernetes.io/projected/dab13cf0-4b26-4a77-93fb-18ccfee54324-kube-api-access-ksstp\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:26.941235 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:26.941178 4498 cadvisor_stats_provider.go:569] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab13cf0_4b26_4a77_93fb_18ccfee54324.slice/crio-b515de442389f8b5db8643ddad9c741ff50245282bc31dd46bea2986d4e81b36\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128c0a65_3a51_4317_8522_9e935d474671.slice/crio-a3bf1bc985895c99fde4499b954eb95044130db06a8a410c357cb2918bcfcf44\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d4357e_e83f_4fff_a979_8a15e767a0ab.slice\": RecentStats: unable to find data in memory cache]" Oct 30 13:21:26.956001 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.955969 4498 generic.go:356] "Generic (PLEG): container finished" podID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerID="1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808" exitCode=0 Oct 30 13:21:26.956163 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.956046 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" Oct 30 13:21:26.956163 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.956049 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" event={"ID":"dab13cf0-4b26-4a77-93fb-18ccfee54324","Type":"ContainerDied","Data":"1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808"} Oct 30 13:21:26.956365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.956238 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg" event={"ID":"dab13cf0-4b26-4a77-93fb-18ccfee54324","Type":"ContainerDied","Data":"b515de442389f8b5db8643ddad9c741ff50245282bc31dd46bea2986d4e81b36"} Oct 30 13:21:26.956365 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.956282 4498 scope.go:122] "RemoveContainer" containerID="1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808" Oct 30 13:21:26.957545 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.957517 4498 generic.go:356] "Generic (PLEG): container finished" podID="128c0a65-3a51-4317-8522-9e935d474671" containerID="0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289" exitCode=0 Oct 30 13:21:26.957669 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.957593 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" event={"ID":"128c0a65-3a51-4317-8522-9e935d474671","Type":"ContainerDied","Data":"0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289"} Oct 30 13:21:26.957669 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.957633 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" event={"ID":"128c0a65-3a51-4317-8522-9e935d474671","Type":"ContainerDied","Data":"a3bf1bc985895c99fde4499b954eb95044130db06a8a410c357cb2918bcfcf44"} Oct 30 13:21:26.957788 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.957766 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx" Oct 30 13:21:26.959437 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.959414 4498 generic.go:356] "Generic (PLEG): container finished" podID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerID="7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432" exitCode=0 Oct 30 13:21:26.959567 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.959451 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" event={"ID":"89d4357e-e83f-4fff-a979-8a15e767a0ab","Type":"ContainerDied","Data":"7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432"} Oct 30 13:21:26.959567 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.959458 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" Oct 30 13:21:26.959567 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.959488 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9" event={"ID":"89d4357e-e83f-4fff-a979-8a15e767a0ab","Type":"ContainerDied","Data":"5c665f79945ac4530cfd791800b0e61e6412d2efc268fcf7f653b9085340f5ce"} Oct 30 13:21:26.966267 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.966249 4498 scope.go:122] "RemoveContainer" containerID="1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808" Oct 30 13:21:26.966568 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:26.966543 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808\": container with ID starting with 1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808 not found: ID does not exist" containerID="1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808" Oct 30 13:21:26.966684 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.966571 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808"} err="failed to get container status \"1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808\": rpc error: code = NotFound desc = could not find container \"1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808\": container with ID starting with 1adecc0d8677aff4c3491bd72130b1dea94ed16be14bb4c986db7df603c11808 not found: ID does not exist" Oct 30 13:21:26.966684 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.966587 4498 scope.go:122] "RemoveContainer" containerID="0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289" Oct 30 13:21:26.976306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.976287 4498 scope.go:122] "RemoveContainer" containerID="0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289" Oct 30 13:21:26.976601 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:26.976583 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289\": container with ID starting with 0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289 not found: ID does not exist" containerID="0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289" Oct 30 13:21:26.976653 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.976608 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289"} err="failed to get container status \"0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289\": rpc error: code = NotFound desc = could not find container \"0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289\": container with ID starting with 0b2c7eb081aec9acf5335c6efb4fafd9f46b75dda775c1380e6ecf7b6ec5f289 not found: ID does not exist" Oct 30 13:21:26.976653 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.976623 4498 scope.go:122] "RemoveContainer" containerID="7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432" Oct 30 13:21:26.985121 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.985102 4498 scope.go:122] "RemoveContainer" containerID="7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432" Oct 30 13:21:26.985444 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:26.985425 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432\": container with ID starting with 7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432 not found: ID does not exist" containerID="7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432" Oct 30 13:21:26.985516 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:26.985449 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432"} err="failed to get container status \"7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432\": rpc error: code = NotFound desc = could not find container \"7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432\": container with ID starting with 7220ec7e43416312276870f845888c65e90862220dd6c1cf30b4255248b8d432 not found: ID does not exist" Oct 30 13:21:27.007627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:27.007601 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx"] Oct 30 13:21:27.010952 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:27.010936 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-5rwtx"] Oct 30 13:21:27.059492 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:27.059466 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9"] Oct 30 13:21:27.071771 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:27.071748 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-26nt9"] Oct 30 13:21:27.108495 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:27.108459 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg"] Oct 30 13:21:27.117489 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:27.117462 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-f76c09-openshift-default-65d5845b67-99klg"] Oct 30 13:21:28.900293 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:28.900262 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="128c0a65-3a51-4317-8522-9e935d474671" path="/var/lib/kubelet/pods/128c0a65-3a51-4317-8522-9e935d474671/volumes" Oct 30 13:21:28.900692 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:28.900679 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" path="/var/lib/kubelet/pods/89d4357e-e83f-4fff-a979-8a15e767a0ab/volumes" Oct 30 13:21:28.901042 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:28.901030 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" path="/var/lib/kubelet/pods/dab13cf0-4b26-4a77-93fb-18ccfee54324/volumes" Oct 30 13:21:29.778398 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:29.778365 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:21:36.279630 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:36.279594 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n"] Oct 30 13:21:36.280145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:36.279839 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" containerID="cri-o://d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d" gracePeriod=30 Oct 30 13:21:36.289905 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:36.289876 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g"] Oct 30 13:21:36.290162 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:36.290135 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" containerID="cri-o://2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23" gracePeriod=30 Oct 30 13:21:39.467076 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.467002 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" containerID="cri-o://9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1" gracePeriod=45 Oct 30 13:21:39.620652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.620615 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": dial tcp 10.133.0.49:8000: connect: connection refused" Oct 30 13:21:39.722271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.722210 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:21:39.859303 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859274 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache\") pod \"3819617d-f020-4a82-bab5-0159bf326856\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " Oct 30 13:21:39.859494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859318 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir\") pod \"3819617d-f020-4a82-bab5-0159bf326856\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " Oct 30 13:21:39.859494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859437 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc\" (UniqueName: \"kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc\") pod \"3819617d-f020-4a82-bab5-0159bf326856\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " Oct 30 13:21:39.859622 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859501 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs\" (UniqueName: \"kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs\") pod \"3819617d-f020-4a82-bab5-0159bf326856\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " Oct 30 13:21:39.859622 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859546 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache" pod "3819617d-f020-4a82-bab5-0159bf326856" (UID: "3819617d-f020-4a82-bab5-0159bf326856"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:39.859622 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859563 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir" pod "3819617d-f020-4a82-bab5-0159bf326856" (UID: "3819617d-f020-4a82-bab5-0159bf326856"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:39.859622 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859567 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm\") pod \"3819617d-f020-4a82-bab5-0159bf326856\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " Oct 30 13:21:39.859622 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859615 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home\") pod \"3819617d-f020-4a82-bab5-0159bf326856\" (UID: \"3819617d-f020-4a82-bab5-0159bf326856\") " Oct 30 13:21:39.859891 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.859831 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home" pod "3819617d-f020-4a82-bab5-0159bf326856" (UID: "3819617d-f020-4a82-bab5-0159bf326856"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:39.860039 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.860018 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:39.860039 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.860035 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:39.860039 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.860043 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:39.861758 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.861733 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs" pod "3819617d-f020-4a82-bab5-0159bf326856" (UID: "3819617d-f020-4a82-bab5-0159bf326856"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:39.861853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.861765 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm" pod "3819617d-f020-4a82-bab5-0159bf326856" (UID: "3819617d-f020-4a82-bab5-0159bf326856"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:39.861853 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.861781 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc" pod "3819617d-f020-4a82-bab5-0159bf326856" (UID: "3819617d-f020-4a82-bab5-0159bf326856"). InnerVolumeSpecName "kube-api-access-656hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:39.960636 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.960602 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-656hc\" (UniqueName: \"kubernetes.io/projected/3819617d-f020-4a82-bab5-0159bf326856-kube-api-access-656hc\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:39.960636 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.960629 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3819617d-f020-4a82-bab5-0159bf326856-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:39.960636 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:39.960641 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3819617d-f020-4a82-bab5-0159bf326856-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:40.026376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.026276 4498 generic.go:356] "Generic (PLEG): container finished" podID="3819617d-f020-4a82-bab5-0159bf326856" containerID="9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1" exitCode=0 Oct 30 13:21:40.026376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.026333 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" Oct 30 13:21:40.026376 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.026355 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" event={"ID":"3819617d-f020-4a82-bab5-0159bf326856","Type":"ContainerDied","Data":"9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1"} Oct 30 13:21:40.026632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.026402 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8" event={"ID":"3819617d-f020-4a82-bab5-0159bf326856","Type":"ContainerDied","Data":"3e43cede1c56b04bfab1a593b3fbe8f684e5a87a0a4866fce08b4bec104751c2"} Oct 30 13:21:40.026632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.026424 4498 scope.go:122] "RemoveContainer" containerID="9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1" Oct 30 13:21:40.035876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.035859 4498 scope.go:122] "RemoveContainer" containerID="9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1" Oct 30 13:21:40.036187 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:40.036168 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1\": container with ID starting with 9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1 not found: ID does not exist" containerID="9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1" Oct 30 13:21:40.036285 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.036227 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1"} err="failed to get container status \"9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1\": rpc error: code = NotFound desc = could not find container \"9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1\": container with ID starting with 9be1ccbb5d77730bf2ba50da5d1ae12163f06c965456f6c5739ccae3c9728ea1 not found: ID does not exist" Oct 30 13:21:40.073896 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.073869 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8"] Oct 30 13:21:40.084140 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.084112 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-ab3176/premium-w6-ab3176-kserve-799cc5f554-94kf8"] Oct 30 13:21:40.900214 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:40.900169 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3819617d-f020-4a82-bab5-0159bf326856" path="/var/lib/kubelet/pods/3819617d-f020-4a82-bab5-0159bf326856/volumes" Oct 30 13:21:41.545631 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.545577 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:21:41.567162 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.567137 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:21:41.676554 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676524 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.676724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676582 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.676724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676600 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.676724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676621 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.676724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676641 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.676724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676658 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.676724 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676700 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.677000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676730 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.677000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676759 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.677000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.676785 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.677344 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677308 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.677469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677447 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.677553 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677521 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.677613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677572 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:41.677613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677597 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.677721 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677633 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.677721 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677676 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.677824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677781 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.677824 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677797 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.677994 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677867 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs\") pod \"573b5462-e31a-49ae-a5f0-d06f003a4cce\" (UID: \"573b5462-e31a-49ae-a5f0-d06f003a4cce\") " Oct 30 13:21:41.677994 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677926 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo\") pod \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\" (UID: \"57de8d17-4a57-4d5f-a163-42dbc0c57daf\") " Oct 30 13:21:41.678111 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.677985 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.678249 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678214 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.678579 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678554 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:41.678810 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678794 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/573b5462-e31a-49ae-a5f0-d06f003a4cce-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.678909 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678898 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.679000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678989 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.679076 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.679065 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.679158 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.679139 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.679313 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.679284 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.679377 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678818 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.679377 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678845 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.679377 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678984 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.679377 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.678291 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.680929 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.680781 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:41.689465 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.689346 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.689777 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.689702 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:21:41.689894 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.689862 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:21:41.689957 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.689944 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl" pod "57de8d17-4a57-4d5f-a163-42dbc0c57daf" (UID: "57de8d17-4a57-4d5f-a163-42dbc0c57daf"). InnerVolumeSpecName "kube-api-access-26gsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:41.690022 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.689969 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:41.690022 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.689979 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "kube-api-access-krprx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:41.691386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.691359 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo" pod "573b5462-e31a-49ae-a5f0-d06f003a4cce" (UID: "573b5462-e31a-49ae-a5f0-d06f003a4cce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:21:41.780399 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780361 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780399 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780399 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780414 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780426 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780438 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780450 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780462 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780475 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26gsl\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-kube-api-access-26gsl\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780488 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780501 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57de8d17-4a57-4d5f-a163-42dbc0c57daf-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780513 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krprx\" (UniqueName: \"kubernetes.io/projected/573b5462-e31a-49ae-a5f0-d06f003a4cce-kube-api-access-krprx\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:41.780598 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:41.780524 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/573b5462-e31a-49ae-a5f0-d06f003a4cce-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:42.037318 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.037273 4498 generic.go:356] "Generic (PLEG): container finished" podID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerID="2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23" exitCode=0 Oct 30 13:21:42.037846 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.037339 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" Oct 30 13:21:42.037846 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.037352 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" event={"ID":"57de8d17-4a57-4d5f-a163-42dbc0c57daf","Type":"ContainerDied","Data":"2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23"} Oct 30 13:21:42.037846 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.037411 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g" event={"ID":"57de8d17-4a57-4d5f-a163-42dbc0c57daf","Type":"ContainerDied","Data":"7425be316b37ea197d2f5d01ce4e1ce64828e42072f6a3ff3db9aea025b2c93c"} Oct 30 13:21:42.037846 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.037427 4498 scope.go:122] "RemoveContainer" containerID="2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23" Oct 30 13:21:42.039103 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.039073 4498 generic.go:356] "Generic (PLEG): container finished" podID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerID="d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d" exitCode=0 Oct 30 13:21:42.039263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.039140 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" Oct 30 13:21:42.039263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.039174 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" event={"ID":"573b5462-e31a-49ae-a5f0-d06f003a4cce","Type":"ContainerDied","Data":"d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d"} Oct 30 13:21:42.039263 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.039253 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n" event={"ID":"573b5462-e31a-49ae-a5f0-d06f003a4cce","Type":"ContainerDied","Data":"8c613a8abe6bb1abe17a95f4c981a394385657b6f6ed577e608fe19f72aa62fc"} Oct 30 13:21:42.048584 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.048563 4498 scope.go:122] "RemoveContainer" containerID="2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23" Oct 30 13:21:42.048947 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:42.048921 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23\": container with ID starting with 2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23 not found: ID does not exist" containerID="2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23" Oct 30 13:21:42.049041 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.048965 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23"} err="failed to get container status \"2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23\": rpc error: code = NotFound desc = could not find container \"2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23\": container with ID starting with 2aad9b3c55a0fc2afbef8e3ea8115ae9765428ea8f5a9abc608fb74e84651a23 not found: ID does not exist" Oct 30 13:21:42.049041 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.048989 4498 scope.go:122] "RemoveContainer" containerID="d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d" Oct 30 13:21:42.057762 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.057743 4498 scope.go:122] "RemoveContainer" containerID="d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d" Oct 30 13:21:42.058029 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:42.058011 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d\": container with ID starting with d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d not found: ID does not exist" containerID="d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d" Oct 30 13:21:42.058071 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.058036 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d"} err="failed to get container status \"d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d\": rpc error: code = NotFound desc = could not find container \"d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d\": container with ID starting with d32f94659b5eabf5e24550e8d082066b89e744b8c5e681d3032469825dc7ac9d not found: ID does not exist" Oct 30 13:21:42.096970 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.096939 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g"] Oct 30 13:21:42.107409 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.107382 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-xvf9g"] Oct 30 13:21:42.147051 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.147017 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n"] Oct 30 13:21:42.149562 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.149540 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-88f6a4-openshift-default-64b46ffd7-q6h8n"] Oct 30 13:21:42.898855 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.898823 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" path="/var/lib/kubelet/pods/573b5462-e31a-49ae-a5f0-d06f003a4cce/volumes" Oct 30 13:21:42.899237 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:42.899223 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" path="/var/lib/kubelet/pods/57de8d17-4a57-4d5f-a163-42dbc0c57daf/volumes" Oct 30 13:21:46.103451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.103411 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk"] Oct 30 13:21:46.103932 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.103652 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" podUID="8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" containerName="maas-api" containerID="cri-o://3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada" gracePeriod=30 Oct 30 13:21:46.577000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.576977 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:21:46.737976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.737924 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847\" (UniqueName: \"kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847\") pod \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " Oct 30 13:21:46.738189 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.737998 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\") pod \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " Oct 30 13:21:46.738189 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.738112 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca\") pod \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " Oct 30 13:21:46.738189 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.738144 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs\") pod \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\" (UID: \"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0\") " Oct 30 13:21:46.738535 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.738509 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca" pod "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" (UID: "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:21:46.743602 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.743557 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs" pod "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" (UID: "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:46.743764 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.743699 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls" pod "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" (UID: "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:21:46.744058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.744030 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847" pod "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" (UID: "8959a267-e5fd-4e93-a5cc-a0cd380bbfe0"). InnerVolumeSpecName "kube-api-access-wx847". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:21:46.839520 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.839487 4498 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:46.839520 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.839513 4498 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:46.839520 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.839522 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx847\" (UniqueName: \"kubernetes.io/projected/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-kube-api-access-wx847\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:46.839751 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:46.839531 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:21:47.068058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.067271 4498 generic.go:356] "Generic (PLEG): container finished" podID="8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" containerID="3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada" exitCode=0 Oct 30 13:21:47.068058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.067353 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" Oct 30 13:21:47.068058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.067356 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" event={"ID":"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0","Type":"ContainerDied","Data":"3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada"} Oct 30 13:21:47.068058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.067448 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk" event={"ID":"8959a267-e5fd-4e93-a5cc-a0cd380bbfe0","Type":"ContainerDied","Data":"8de20596b717a968b2a62a91a676b85a07ad485a65d1df6ecfee4014e70e4b9b"} Oct 30 13:21:47.068058 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.067509 4498 scope.go:122] "RemoveContainer" containerID="3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada" Oct 30 13:21:47.085965 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.085934 4498 scope.go:122] "RemoveContainer" containerID="3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada" Oct 30 13:21:47.086443 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:47.086416 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada\": container with ID starting with 3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada not found: ID does not exist" containerID="3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada" Oct 30 13:21:47.086619 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.086454 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada"} err="failed to get container status \"3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada\": rpc error: code = NotFound desc = could not find container \"3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada\": container with ID starting with 3334d16f6f27e6b167440538228084caeaf038863a49ddca8be9e8ca53050ada not found: ID does not exist" Oct 30 13:21:47.152556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.152524 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk"] Oct 30 13:21:47.165189 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:47.165163 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-ab3176-bb594587b-z6nwk"] Oct 30 13:21:48.898893 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:21:48.898862 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" path="/var/lib/kubelet/pods/8959a267-e5fd-4e93-a5cc-a0cd380bbfe0/volumes" Oct 30 13:21:59.777933 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:21:59.777889 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:22:05.017083 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:22:05.017057 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:22:05.020446 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:22:05.020424 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:22:05.749593 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:22:05.749562 4498 scope.go:122] "RemoveContainer" containerID="ced365b1096b7cd863ddd01bfa5b9b0c4d086ee8ae3580f01783c0d97ab719fb" Oct 30 13:22:29.775072 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:22:29.775033 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:22:59.774532 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:22:59.774491 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:23:29.774174 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:23:29.774095 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:23:59.775216 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:23:59.775158 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:24:29.774435 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:24:29.774392 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:24:59.774688 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:24:59.774648 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:25:29.773925 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:25:29.773879 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:25:59.776041 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:25:59.776002 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:26:29.774720 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:26:29.774685 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:26:59.773952 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:26:59.773912 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:27:05.048924 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:27:05.048892 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:27:05.050722 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:27:05.050695 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:27:29.775287 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:27:29.775250 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:27:59.775740 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:27:59.775697 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:28:25.604993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.604955 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5"] Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605340 4498 cpu_manager.go:414] "containerMap: removing container" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605353 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605370 4498 cpu_manager.go:414] "containerMap: removing container" podUID="a9ec3890-f9fc-48d4-802b-3ea67d1a3408" containerName="maas-api" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605375 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a9ec3890-f9fc-48d4-802b-3ea67d1a3408" containerName="maas-api" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605383 4498 cpu_manager.go:414] "containerMap: removing container" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605388 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605402 4498 cpu_manager.go:414] "containerMap: removing container" podUID="a5360e13-b776-4843-82f7-4ba122aada7f" containerName="maas-api" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605420 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5360e13-b776-4843-82f7-4ba122aada7f" containerName="maas-api" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605431 4498 cpu_manager.go:414] "containerMap: removing container" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605437 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605447 4498 cpu_manager.go:414] "containerMap: removing container" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605452 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605459 4498 cpu_manager.go:414] "containerMap: removing container" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605464 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605471 4498 cpu_manager.go:414] "containerMap: removing container" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605474 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605483 4498 cpu_manager.go:414] "containerMap: removing container" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605489 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605501 4498 cpu_manager.go:414] "containerMap: removing container" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605508 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605518 4498 cpu_manager.go:414] "containerMap: removing container" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605523 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605530 4498 cpu_manager.go:414] "containerMap: removing container" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605534 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605539 4498 cpu_manager.go:414] "containerMap: removing container" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605543 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605549 4498 cpu_manager.go:414] "containerMap: removing container" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605553 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605559 4498 cpu_manager.go:414] "containerMap: removing container" podUID="8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" containerName="maas-api" Oct 30 13:28:25.605599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605564 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" containerName="maas-api" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605621 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5360e13-b776-4843-82f7-4ba122aada7f" containerName="maas-api" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605629 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b5b88be-8533-461c-afae-ba189119a4f7" containerName="main" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605635 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="dbcfee04-6fa6-474b-9043-5ce48967c996" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605641 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b2e44f6-ba31-4d19-9c52-5bc30252fc56" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605646 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="88d7199a-e822-4f39-9880-fedafd700532" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605652 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ec0beab-649b-4134-a2b5-55b028f40172" containerName="main" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605658 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="57de8d17-4a57-4d5f-a163-42dbc0c57daf" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605663 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="128c0a65-3a51-4317-8522-9e935d474671" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605669 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="573b5462-e31a-49ae-a5f0-d06f003a4cce" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605673 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="dab13cf0-4b26-4a77-93fb-18ccfee54324" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605679 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="89d4357e-e83f-4fff-a979-8a15e767a0ab" containerName="istio-proxy" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605684 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="8959a267-e5fd-4e93-a5cc-a0cd380bbfe0" containerName="maas-api" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605689 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="cb45ebbb-cffc-4221-ae94-9ede32f187f4" containerName="main" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605694 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="a9ec3890-f9fc-48d4-802b-3ea67d1a3408" containerName="maas-api" Oct 30 13:28:25.606595 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.605699 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="3819617d-f020-4a82-bab5-0159bf326856" containerName="main" Oct 30 13:28:25.608577 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.608560 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.631759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.631727 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-3eceab\"/\"default-dockercfg-qw4h6\"" Oct 30 13:28:25.631939 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.631826 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-3eceab\"/\"openshift-service-ca.crt\"" Oct 30 13:28:25.631939 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.631877 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-3eceab\"/\"simulator-single-main-3eceab-kserve-self-signed-certs\"" Oct 30 13:28:25.632130 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.632101 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-3eceab\"/\"kube-root-ca.crt\"" Oct 30 13:28:25.634307 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.634287 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5"] Oct 30 13:28:25.692912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.692872 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5sn\" (UniqueName: \"kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.692912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.692913 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.693155 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.692938 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.693155 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.693074 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.693155 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.693112 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.693305 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.693206 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794161 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794224 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794264 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794300 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5sn\" (UniqueName: \"kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794316 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794494 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794340 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794693 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794652 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794731 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794705 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.794765 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.794738 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.796590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.796562 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.796900 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.796879 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.816008 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.815982 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5sn\" (UniqueName: \"kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn\") pod \"simulator-single-main-3eceab-kserve-75df4745d9-fgmw5\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:25.925641 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:25.925557 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:26.226213 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:26.226164 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5"] Oct 30 13:28:26.229833 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:28:26.229803 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72bb0fed_2e36_4204_910d_1837dcb2c10f.slice/crio-cdeac0020a93ffda97dfb493bc102db0e0e8d4e7761b9b7e1c9d0794493b4860 WatchSource:0}: Error finding container cdeac0020a93ffda97dfb493bc102db0e0e8d4e7761b9b7e1c9d0794493b4860: Status 404 returned error can't find the container with id cdeac0020a93ffda97dfb493bc102db0e0e8d4e7761b9b7e1c9d0794493b4860 Oct 30 13:28:26.934469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:26.934436 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" event={"ID":"72bb0fed-2e36-4204-910d-1837dcb2c10f","Type":"ContainerStarted","Data":"1a6536691438acbc5285ff293a0302e23e86a571a8087f350b24abcf2da565ce"} Oct 30 13:28:26.934469 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:26.934478 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" event={"ID":"72bb0fed-2e36-4204-910d-1837dcb2c10f","Type":"ContainerStarted","Data":"cdeac0020a93ffda97dfb493bc102db0e0e8d4e7761b9b7e1c9d0794493b4860"} Oct 30 13:28:26.974402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:26.974352 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" podStartSLOduration=1.974338887 podStartE2EDuration="1.974338887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:28:26.972550498 +0000 UTC m=+1882.202833633" watchObservedRunningTime="2026-10-30 13:28:26.974338887 +0000 UTC m=+1882.204622023" Oct 30 13:28:27.926098 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:27.926052 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:29.774788 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:28:29.774752 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:28:35.925821 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:35.925788 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:35.938314 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:35.938284 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:35.991237 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:28:35.991185 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:28:59.775934 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:28:59.775886 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:29:04.928646 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:04.928612 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5"] Oct 30 13:29:19.949017 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:19.948906 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" podUID="72bb0fed-2e36-4204-910d-1837dcb2c10f" containerName="main" containerID="cri-o://1a6536691438acbc5285ff293a0302e23e86a571a8087f350b24abcf2da565ce" gracePeriod=45 Oct 30 13:29:19.979692 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:19.979661 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" podUID="72bb0fed-2e36-4204-910d-1837dcb2c10f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.70:8000/ready\": dial tcp 10.133.0.70:8000: connect: connection refused" Oct 30 13:29:20.167438 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.167409 4498 generic.go:356] "Generic (PLEG): container finished" podID="72bb0fed-2e36-4204-910d-1837dcb2c10f" containerID="1a6536691438acbc5285ff293a0302e23e86a571a8087f350b24abcf2da565ce" exitCode=0 Oct 30 13:29:20.167606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.167478 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" event={"ID":"72bb0fed-2e36-4204-910d-1837dcb2c10f","Type":"ContainerDied","Data":"1a6536691438acbc5285ff293a0302e23e86a571a8087f350b24abcf2da565ce"} Oct 30 13:29:20.196590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.196567 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:29:20.379590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379492 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn\" (UniqueName: \"kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn\") pod \"72bb0fed-2e36-4204-910d-1837dcb2c10f\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " Oct 30 13:29:20.379590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379545 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home\") pod \"72bb0fed-2e36-4204-910d-1837dcb2c10f\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " Oct 30 13:29:20.379590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379572 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs\" (UniqueName: \"kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs\") pod \"72bb0fed-2e36-4204-910d-1837dcb2c10f\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " Oct 30 13:29:20.379590 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379600 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm\") pod \"72bb0fed-2e36-4204-910d-1837dcb2c10f\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " Oct 30 13:29:20.379955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379620 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir\") pod \"72bb0fed-2e36-4204-910d-1837dcb2c10f\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " Oct 30 13:29:20.379955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379640 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache\") pod \"72bb0fed-2e36-4204-910d-1837dcb2c10f\" (UID: \"72bb0fed-2e36-4204-910d-1837dcb2c10f\") " Oct 30 13:29:20.379955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379832 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home" pod "72bb0fed-2e36-4204-910d-1837dcb2c10f" (UID: "72bb0fed-2e36-4204-910d-1837dcb2c10f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:29:20.379955 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379915 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir" pod "72bb0fed-2e36-4204-910d-1837dcb2c10f" (UID: "72bb0fed-2e36-4204-910d-1837dcb2c10f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:29:20.380102 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.379979 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache" pod "72bb0fed-2e36-4204-910d-1837dcb2c10f" (UID: "72bb0fed-2e36-4204-910d-1837dcb2c10f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:29:20.381876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.381853 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm" pod "72bb0fed-2e36-4204-910d-1837dcb2c10f" (UID: "72bb0fed-2e36-4204-910d-1837dcb2c10f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:29:20.381984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.381918 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn" pod "72bb0fed-2e36-4204-910d-1837dcb2c10f" (UID: "72bb0fed-2e36-4204-910d-1837dcb2c10f"). InnerVolumeSpecName "kube-api-access-nb5sn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:29:20.381984 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.381932 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs" pod "72bb0fed-2e36-4204-910d-1837dcb2c10f" (UID: "72bb0fed-2e36-4204-910d-1837dcb2c10f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:29:20.480309 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.480274 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nb5sn\" (UniqueName: \"kubernetes.io/projected/72bb0fed-2e36-4204-910d-1837dcb2c10f-kube-api-access-nb5sn\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:20.480309 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.480303 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:20.480507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.480317 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72bb0fed-2e36-4204-910d-1837dcb2c10f-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:20.480507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.480330 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:20.480507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.480340 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:20.480507 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:20.480350 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72bb0fed-2e36-4204-910d-1837dcb2c10f-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:21.173866 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:21.173775 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" Oct 30 13:29:21.173866 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:21.173790 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5" event={"ID":"72bb0fed-2e36-4204-910d-1837dcb2c10f","Type":"ContainerDied","Data":"cdeac0020a93ffda97dfb493bc102db0e0e8d4e7761b9b7e1c9d0794493b4860"} Oct 30 13:29:21.173866 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:21.173844 4498 scope.go:122] "RemoveContainer" containerID="1a6536691438acbc5285ff293a0302e23e86a571a8087f350b24abcf2da565ce" Oct 30 13:29:21.221592 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:21.221565 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5"] Oct 30 13:29:21.226367 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:21.226340 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-3eceab/simulator-single-main-3eceab-kserve-75df4745d9-fgmw5"] Oct 30 13:29:22.899613 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:22.899581 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72bb0fed-2e36-4204-910d-1837dcb2c10f" path="/var/lib/kubelet/pods/72bb0fed-2e36-4204-910d-1837dcb2c10f/volumes" Oct 30 13:29:29.775008 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:29:29.774965 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:29:56.648175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:56.648140 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q"] Oct 30 13:29:56.648708 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:56.648365 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" podUID="3253b26b-8188-414a-adeb-5a560011ffc0" containerName="manager" containerID="cri-o://f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a" gracePeriod=10 Oct 30 13:29:56.900529 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:56.900468 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:29:57.010037 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.010008 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8\" (UniqueName: \"kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8\") pod \"3253b26b-8188-414a-adeb-5a560011ffc0\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " Oct 30 13:29:57.010228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.010130 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume\") pod \"3253b26b-8188-414a-adeb-5a560011ffc0\" (UID: \"3253b26b-8188-414a-adeb-5a560011ffc0\") " Oct 30 13:29:57.010527 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.010503 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume" pod "3253b26b-8188-414a-adeb-5a560011ffc0" (UID: "3253b26b-8188-414a-adeb-5a560011ffc0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:29:57.012371 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.012348 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8" pod "3253b26b-8188-414a-adeb-5a560011ffc0" (UID: "3253b26b-8188-414a-adeb-5a560011ffc0"). InnerVolumeSpecName "kube-api-access-q9pm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:29:57.111587 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.111551 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9pm8\" (UniqueName: \"kubernetes.io/projected/3253b26b-8188-414a-adeb-5a560011ffc0-kube-api-access-q9pm8\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:57.111587 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.111582 4498 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3253b26b-8188-414a-adeb-5a560011ffc0-extensions-socket-volume\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:29:57.340271 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.340240 4498 generic.go:356] "Generic (PLEG): container finished" podID="3253b26b-8188-414a-adeb-5a560011ffc0" containerID="f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a" exitCode=0 Oct 30 13:29:57.340457 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.340277 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" event={"ID":"3253b26b-8188-414a-adeb-5a560011ffc0","Type":"ContainerDied","Data":"f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a"} Oct 30 13:29:57.340457 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.340288 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" Oct 30 13:29:57.340457 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.340313 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q" event={"ID":"3253b26b-8188-414a-adeb-5a560011ffc0","Type":"ContainerDied","Data":"c979eb4d61729ae98a31c09f71fd1a2d3536f0869ba1b19dcac2d2eb552da162"} Oct 30 13:29:57.340457 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.340334 4498 scope.go:122] "RemoveContainer" containerID="f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a" Oct 30 13:29:57.356757 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.356729 4498 scope.go:122] "RemoveContainer" containerID="f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a" Oct 30 13:29:57.357093 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:29:57.357055 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a\": container with ID starting with f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a not found: ID does not exist" containerID="f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a" Oct 30 13:29:57.357185 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.357116 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a"} err="failed to get container status \"f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a\": rpc error: code = NotFound desc = could not find container \"f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a\": container with ID starting with f634638dfeba0c9c645f58114aa0c9552afb7680a953ae1ea476986af858676a not found: ID does not exist" Oct 30 13:29:57.387112 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.387081 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q"] Oct 30 13:29:57.397486 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:57.397463 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-kdc8q"] Oct 30 13:29:58.898976 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:29:58.898946 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3253b26b-8188-414a-adeb-5a560011ffc0" path="/var/lib/kubelet/pods/3253b26b-8188-414a-adeb-5a560011ffc0/volumes" Oct 30 13:29:59.774826 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:29:59.774794 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:30:29.773903 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:30:29.773864 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:30:59.775458 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:30:59.775418 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:30:59.875259 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875225 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8"] Oct 30 13:30:59.875605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875591 4498 cpu_manager.go:414] "containerMap: removing container" podUID="3253b26b-8188-414a-adeb-5a560011ffc0" containerName="manager" Oct 30 13:30:59.875649 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875607 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3253b26b-8188-414a-adeb-5a560011ffc0" containerName="manager" Oct 30 13:30:59.875649 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875627 4498 cpu_manager.go:414] "containerMap: removing container" podUID="72bb0fed-2e36-4204-910d-1837dcb2c10f" containerName="main" Oct 30 13:30:59.875649 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875632 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72bb0fed-2e36-4204-910d-1837dcb2c10f" containerName="main" Oct 30 13:30:59.875744 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875694 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="3253b26b-8188-414a-adeb-5a560011ffc0" containerName="manager" Oct 30 13:30:59.875744 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.875703 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="72bb0fed-2e36-4204-910d-1837dcb2c10f" containerName="main" Oct 30 13:30:59.878489 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.878475 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:30:59.891911 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.891885 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Oct 30 13:30:59.892262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.892243 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6szdh\"" Oct 30 13:30:59.902560 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.902536 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Oct 30 13:30:59.904011 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.903990 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8"] Oct 30 13:30:59.924173 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.924142 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b1d5417-c710-4132-879b-ba54c9b5e1b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-7wsh8\" (UID: \"5b1d5417-c710-4132-879b-ba54c9b5e1b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:30:59.924336 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:30:59.924279 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kztgz\" (UniqueName: \"kubernetes.io/projected/5b1d5417-c710-4132-879b-ba54c9b5e1b5-kube-api-access-kztgz\") pod \"kuadrant-operator-controller-manager-57bb9bfff-7wsh8\" (UID: \"5b1d5417-c710-4132-879b-ba54c9b5e1b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:00.025402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.025354 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b1d5417-c710-4132-879b-ba54c9b5e1b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-7wsh8\" (UID: \"5b1d5417-c710-4132-879b-ba54c9b5e1b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:00.025599 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.025424 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kztgz\" (UniqueName: \"kubernetes.io/projected/5b1d5417-c710-4132-879b-ba54c9b5e1b5-kube-api-access-kztgz\") pod \"kuadrant-operator-controller-manager-57bb9bfff-7wsh8\" (UID: \"5b1d5417-c710-4132-879b-ba54c9b5e1b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:00.025747 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.025725 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b1d5417-c710-4132-879b-ba54c9b5e1b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-57bb9bfff-7wsh8\" (UID: \"5b1d5417-c710-4132-879b-ba54c9b5e1b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:00.048014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.047978 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kztgz\" (UniqueName: \"kubernetes.io/projected/5b1d5417-c710-4132-879b-ba54c9b5e1b5-kube-api-access-kztgz\") pod \"kuadrant-operator-controller-manager-57bb9bfff-7wsh8\" (UID: \"5b1d5417-c710-4132-879b-ba54c9b5e1b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:00.190384 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.190331 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:00.530893 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.530856 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8"] Oct 30 13:31:00.548467 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:31:00.548439 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1d5417_c710_4132_879b_ba54c9b5e1b5.slice/crio-d02cef2454afc9aac1872a677d0a9280859f6c9b87a3fa5229b763901d552de9 WatchSource:0}: Error finding container d02cef2454afc9aac1872a677d0a9280859f6c9b87a3fa5229b763901d552de9: Status 404 returned error can't find the container with id d02cef2454afc9aac1872a677d0a9280859f6c9b87a3fa5229b763901d552de9 Oct 30 13:31:00.593047 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:00.593020 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" event={"ID":"5b1d5417-c710-4132-879b-ba54c9b5e1b5","Type":"ContainerStarted","Data":"d02cef2454afc9aac1872a677d0a9280859f6c9b87a3fa5229b763901d552de9"} Oct 30 13:31:01.599140 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:01.599109 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" event={"ID":"5b1d5417-c710-4132-879b-ba54c9b5e1b5","Type":"ContainerStarted","Data":"5e6baeabdaef1165895db99ec587a7746d235cae42fcc3cca65ae38a5d0596ba"} Oct 30 13:31:01.599556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:01.599246 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:01.682681 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:01.682628 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" podStartSLOduration=2.68261318 podStartE2EDuration="2.68261318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:31:01.682075823 +0000 UTC m=+2036.912358957" watchObservedRunningTime="2026-10-30 13:31:01.68261318 +0000 UTC m=+2036.912896314" Oct 30 13:31:12.606157 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:31:12.606125 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-57bb9bfff-7wsh8" Oct 30 13:31:29.774414 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:31:29.774378 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:31:59.774609 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:31:59.774573 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:32:05.072396 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:05.072371 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:32:05.075086 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:05.075055 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:32:29.775124 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:32:29.775040 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:32:33.513877 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.513842 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62"] Oct 30 13:32:33.517448 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.517413 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.542956 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.542923 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-c78854\"/\"openshift-service-ca.crt\"" Oct 30 13:32:33.542956 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.542924 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-c78854\"/\"kube-root-ca.crt\"" Oct 30 13:32:33.544462 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.544443 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62"] Oct 30 13:32:33.577529 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.577501 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrr6f\" (UniqueName: \"kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.577529 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.577538 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.577801 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.577565 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.577801 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.577698 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.577801 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.577761 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.577908 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.577870 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.599249 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.599223 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-c78854\"/\"default-dockercfg-wx8kj\"" Oct 30 13:32:33.599652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.599628 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-c78854\"/\"simulator-single-main-c78854-kserve-self-signed-certs\"" Oct 30 13:32:33.678436 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678396 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrr6f\" (UniqueName: \"kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.678642 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678451 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.678642 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678490 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.678642 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678519 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.678642 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678570 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.678642 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678611 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.678949 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.678923 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.679133 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.679012 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.679292 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.679251 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.681338 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.681312 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.681493 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.681475 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.724897 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.724860 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrr6f\" (UniqueName: \"kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f\") pod \"simulator-single-main-c78854-kserve-6849fd7c97-zdx62\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:33.829354 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:33.829269 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:34.134632 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:34.134504 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62"] Oct 30 13:32:34.139485 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:32:34.139456 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33a4a366_5c0e_4d0f_a187_ad1ab40c6291.slice/crio-4748cc5945861eb13805ce012effba1ee69e9b11bec28b39aa2e2b221f587584 WatchSource:0}: Error finding container 4748cc5945861eb13805ce012effba1ee69e9b11bec28b39aa2e2b221f587584: Status 404 returned error can't find the container with id 4748cc5945861eb13805ce012effba1ee69e9b11bec28b39aa2e2b221f587584 Oct 30 13:32:35.027646 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:35.027612 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" event={"ID":"33a4a366-5c0e-4d0f-a187-ad1ab40c6291","Type":"ContainerStarted","Data":"32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d"} Oct 30 13:32:35.028158 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:35.027657 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" event={"ID":"33a4a366-5c0e-4d0f-a187-ad1ab40c6291","Type":"ContainerStarted","Data":"4748cc5945861eb13805ce012effba1ee69e9b11bec28b39aa2e2b221f587584"} Oct 30 13:32:35.066742 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:35.066690 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" podStartSLOduration=2.066675879 podStartE2EDuration="2.066675879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:32:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:32:35.065396562 +0000 UTC m=+2130.295679698" watchObservedRunningTime="2026-10-30 13:32:35.066675879 +0000 UTC m=+2130.296959013" Oct 30 13:32:35.830154 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:35.830119 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:43.830270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:43.830226 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:43.843100 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:43.843072 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:44.080509 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:32:44.080430 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:32:59.774968 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:32:59.774931 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:33:29.775306 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:33:29.775270 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:33:31.031411 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:31.031375 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62"] Oct 30 13:33:46.050993 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.050930 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" podUID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" containerName="main" containerID="cri-o://32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d" gracePeriod=45 Oct 30 13:33:46.069725 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.069697 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" podUID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" containerName="main" probeResult="failure" output="Get \"https://10.133.0.72:8000/ready\": dial tcp 10.133.0.72:8000: connect: connection refused" Oct 30 13:33:46.289768 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.289746 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:33:46.332144 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.332061 4498 generic.go:356] "Generic (PLEG): container finished" podID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" containerID="32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d" exitCode=0 Oct 30 13:33:46.332144 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.332107 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" Oct 30 13:33:46.332144 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.332114 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" event={"ID":"33a4a366-5c0e-4d0f-a187-ad1ab40c6291","Type":"ContainerDied","Data":"32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d"} Oct 30 13:33:46.332374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.332151 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62" event={"ID":"33a4a366-5c0e-4d0f-a187-ad1ab40c6291","Type":"ContainerDied","Data":"4748cc5945861eb13805ce012effba1ee69e9b11bec28b39aa2e2b221f587584"} Oct 30 13:33:46.332374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.332174 4498 scope.go:122] "RemoveContainer" containerID="32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d" Oct 30 13:33:46.348355 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.348332 4498 scope.go:122] "RemoveContainer" containerID="32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d" Oct 30 13:33:46.348710 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:33:46.348684 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d\": container with ID starting with 32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d not found: ID does not exist" containerID="32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d" Oct 30 13:33:46.348767 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.348724 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d"} err="failed to get container status \"32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d\": rpc error: code = NotFound desc = could not find container \"32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d\": container with ID starting with 32888e364d035f5156029cbc4e97e9e836bb4484a363a99df63dda34e877658d not found: ID does not exist" Oct 30 13:33:46.462519 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462490 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache\") pod \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " Oct 30 13:33:46.462695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462537 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm\") pod \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " Oct 30 13:33:46.462695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462578 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs\" (UniqueName: \"kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs\") pod \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " Oct 30 13:33:46.462695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462624 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home\") pod \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " Oct 30 13:33:46.462695 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462665 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir\") pod \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " Oct 30 13:33:46.462946 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462719 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f\" (UniqueName: \"kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f\") pod \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\" (UID: \"33a4a366-5c0e-4d0f-a187-ad1ab40c6291\") " Oct 30 13:33:46.462946 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462819 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache" pod "33a4a366-5c0e-4d0f-a187-ad1ab40c6291" (UID: "33a4a366-5c0e-4d0f-a187-ad1ab40c6291"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:33:46.462946 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.462914 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home" pod "33a4a366-5c0e-4d0f-a187-ad1ab40c6291" (UID: "33a4a366-5c0e-4d0f-a187-ad1ab40c6291"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:33:46.463107 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.463028 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir" pod "33a4a366-5c0e-4d0f-a187-ad1ab40c6291" (UID: "33a4a366-5c0e-4d0f-a187-ad1ab40c6291"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:33:46.463107 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.463040 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:33:46.463107 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.463085 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:33:46.464957 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.464932 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm" pod "33a4a366-5c0e-4d0f-a187-ad1ab40c6291" (UID: "33a4a366-5c0e-4d0f-a187-ad1ab40c6291"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:33:46.465095 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.464994 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs" pod "33a4a366-5c0e-4d0f-a187-ad1ab40c6291" (UID: "33a4a366-5c0e-4d0f-a187-ad1ab40c6291"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:33:46.465095 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.465042 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f" pod "33a4a366-5c0e-4d0f-a187-ad1ab40c6291" (UID: "33a4a366-5c0e-4d0f-a187-ad1ab40c6291"). InnerVolumeSpecName "kube-api-access-hrr6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:33:46.564302 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.564227 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:33:46.564302 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.564254 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:33:46.564302 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.564266 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:33:46.564302 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.564274 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrr6f\" (UniqueName: \"kubernetes.io/projected/33a4a366-5c0e-4d0f-a187-ad1ab40c6291-kube-api-access-hrr6f\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:33:46.700215 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.700167 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62"] Oct 30 13:33:46.704185 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.704156 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-c78854/simulator-single-main-c78854-kserve-6849fd7c97-zdx62"] Oct 30 13:33:46.900631 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:33:46.900557 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" path="/var/lib/kubelet/pods/33a4a366-5c0e-4d0f-a187-ad1ab40c6291/volumes" Oct 30 13:33:59.774772 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:33:59.774732 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:34:01.565449 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.565403 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4"] Oct 30 13:34:01.566266 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.565863 4498 cpu_manager.go:414] "containerMap: removing container" podUID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" containerName="main" Oct 30 13:34:01.566266 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.565878 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" containerName="main" Oct 30 13:34:01.566266 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.565940 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="33a4a366-5c0e-4d0f-a187-ad1ab40c6291" containerName="main" Oct 30 13:34:01.568815 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.568797 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.591667 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.591642 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.591784 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.591679 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.591784 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.591697 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.591784 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.591753 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj8hz\" (UniqueName: \"kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.591913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.591810 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.591913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.591852 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.593988 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.593969 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nwjwf\"" Oct 30 13:34:01.594105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.594044 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Oct 30 13:34:01.594105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.594055 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Oct 30 13:34:01.594105 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.594091 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-0b6c7bb2-kserve-self-signed-certs\"" Oct 30 13:34:01.604448 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.604339 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4"] Oct 30 13:34:01.692464 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692425 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692464 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692467 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692505 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj8hz\" (UniqueName: \"kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692542 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692595 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692719 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692644 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692927 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692898 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.692991 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.692961 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.693050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.693025 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.694960 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.694935 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.695265 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.695245 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.720320 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.720293 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj8hz\" (UniqueName: \"kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz\") pod \"e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:01.881014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:01.880921 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:02.184986 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:02.184954 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4"] Oct 30 13:34:02.407575 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:02.407543 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" event={"ID":"14ab0a40-8740-4b6f-9913-25cd9cc93ff0","Type":"ContainerStarted","Data":"36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5"} Oct 30 13:34:02.407575 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:02.407583 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" event={"ID":"14ab0a40-8740-4b6f-9913-25cd9cc93ff0","Type":"ContainerStarted","Data":"46306c2d3f2d0fc0c6496e1dde19cfdbf3160541831c57d72fda293f386e2a44"} Oct 30 13:34:02.445747 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:02.445644 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" podStartSLOduration=1.445631379 podStartE2EDuration="1.445631379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:34:02.44479278 +0000 UTC m=+2217.675075915" watchObservedRunningTime="2026-10-30 13:34:02.445631379 +0000 UTC m=+2217.675914513" Oct 30 13:34:02.881298 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:02.881185 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:11.881913 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:11.881878 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:11.894102 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:11.894074 4498 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:12.461551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:12.461524 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:34:29.775548 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:34:29.775510 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:34:47.270811 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:47.270772 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4"] Oct 30 13:34:56.079224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:56.078370 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:34:56.079224 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:34:56.078520 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:34:59.775278 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:34:59.775240 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:35:02.292746 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.292707 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" podUID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" containerName="main" containerID="cri-o://36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5" gracePeriod=45 Oct 30 13:35:02.451111 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.451069 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" podUID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" containerName="main" probeResult="failure" output="Get \"https://10.133.0.73:8000/ready\": dial tcp 10.133.0.73:8000: connect: connection refused" Oct 30 13:35:02.547667 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.547608 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:35:02.715606 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715573 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm\") pod \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " Oct 30 13:35:02.715774 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715633 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache\") pod \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " Oct 30 13:35:02.715774 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715675 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz\" (UniqueName: \"kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz\") pod \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " Oct 30 13:35:02.715774 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715697 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs\" (UniqueName: \"kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs\") pod \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " Oct 30 13:35:02.715917 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715792 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir\") pod \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " Oct 30 13:35:02.715917 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715837 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home\") pod \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\" (UID: \"14ab0a40-8740-4b6f-9913-25cd9cc93ff0\") " Oct 30 13:35:02.716031 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.715957 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache" pod "14ab0a40-8740-4b6f-9913-25cd9cc93ff0" (UID: "14ab0a40-8740-4b6f-9913-25cd9cc93ff0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:35:02.716131 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.716096 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir" pod "14ab0a40-8740-4b6f-9913-25cd9cc93ff0" (UID: "14ab0a40-8740-4b6f-9913-25cd9cc93ff0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:35:02.716274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.716132 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home" pod "14ab0a40-8740-4b6f-9913-25cd9cc93ff0" (UID: "14ab0a40-8740-4b6f-9913-25cd9cc93ff0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:35:02.716274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.716162 4498 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-model-cache\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:02.718010 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.717984 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm" pod "14ab0a40-8740-4b6f-9913-25cd9cc93ff0" (UID: "14ab0a40-8740-4b6f-9913-25cd9cc93ff0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:35:02.718109 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.718047 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs" pod "14ab0a40-8740-4b6f-9913-25cd9cc93ff0" (UID: "14ab0a40-8740-4b6f-9913-25cd9cc93ff0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:35:02.718109 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.718048 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz" pod "14ab0a40-8740-4b6f-9913-25cd9cc93ff0" (UID: "14ab0a40-8740-4b6f-9913-25cd9cc93ff0"). InnerVolumeSpecName "kube-api-access-fj8hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:35:02.748450 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.748420 4498 generic.go:356] "Generic (PLEG): container finished" podID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" containerID="36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5" exitCode=0 Oct 30 13:35:02.748594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.748462 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" Oct 30 13:35:02.748594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.748500 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" event={"ID":"14ab0a40-8740-4b6f-9913-25cd9cc93ff0","Type":"ContainerDied","Data":"36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5"} Oct 30 13:35:02.748594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.748544 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4" event={"ID":"14ab0a40-8740-4b6f-9913-25cd9cc93ff0","Type":"ContainerDied","Data":"46306c2d3f2d0fc0c6496e1dde19cfdbf3160541831c57d72fda293f386e2a44"} Oct 30 13:35:02.748594 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.748566 4498 scope.go:122] "RemoveContainer" containerID="36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5" Oct 30 13:35:02.756776 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.756761 4498 scope.go:122] "RemoveContainer" containerID="36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5" Oct 30 13:35:02.757057 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:35:02.757040 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5\": container with ID starting with 36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5 not found: ID does not exist" containerID="36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5" Oct 30 13:35:02.757124 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.757065 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5"} err="failed to get container status \"36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5\": rpc error: code = NotFound desc = could not find container \"36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5\": container with ID starting with 36d961ffadad5d52bbb5628c11025395999f09dc9b42e22eee791abc8c3954b5 not found: ID does not exist" Oct 30 13:35:02.793145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.793116 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4"] Oct 30 13:35:02.797893 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.797828 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-0b6c7bb2-kserve-64b8b4d445-dsjh4"] Oct 30 13:35:02.816777 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.816755 4498 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-home\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:02.816777 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.816776 4498 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-dshm\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:02.816928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.816785 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj8hz\" (UniqueName: \"kubernetes.io/projected/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-kube-api-access-fj8hz\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:02.816928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.816796 4498 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tls-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:02.816928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.816808 4498 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14ab0a40-8740-4b6f-9913-25cd9cc93ff0-tmp-dir\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:02.899222 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:02.899174 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" path="/var/lib/kubelet/pods/14ab0a40-8740-4b6f-9913-25cd9cc93ff0/volumes" Oct 30 13:35:29.774791 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:35:29.774709 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:35:52.309549 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:52.309513 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-c78xj"] Oct 30 13:35:52.310003 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:52.309736 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" podUID="c443a009-a2bf-477a-af1e-22603bb78851" containerName="maas-api" containerID="cri-o://4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765" gracePeriod=30 Oct 30 13:35:53.559564 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.559539 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:35:53.616473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.616440 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs\") pod \"c443a009-a2bf-477a-af1e-22603bb78851\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " Oct 30 13:35:53.616647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.616494 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls\") pod \"c443a009-a2bf-477a-af1e-22603bb78851\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " Oct 30 13:35:53.616647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.616538 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7\" (UniqueName: \"kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7\") pod \"c443a009-a2bf-477a-af1e-22603bb78851\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " Oct 30 13:35:53.616647 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.616594 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca\") pod \"c443a009-a2bf-477a-af1e-22603bb78851\" (UID: \"c443a009-a2bf-477a-af1e-22603bb78851\") " Oct 30 13:35:53.617082 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.617047 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca" pod "c443a009-a2bf-477a-af1e-22603bb78851" (UID: "c443a009-a2bf-477a-af1e-22603bb78851"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:35:53.618707 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.618676 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls" pod "c443a009-a2bf-477a-af1e-22603bb78851" (UID: "c443a009-a2bf-477a-af1e-22603bb78851"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:35:53.618829 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.618771 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs" pod "c443a009-a2bf-477a-af1e-22603bb78851" (UID: "c443a009-a2bf-477a-af1e-22603bb78851"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:35:53.618829 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.618790 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7" pod "c443a009-a2bf-477a-af1e-22603bb78851" (UID: "c443a009-a2bf-477a-af1e-22603bb78851"). InnerVolumeSpecName "kube-api-access-52mb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:35:53.718127 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.718099 4498 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-metrics-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:53.718127 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.718125 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c443a009-a2bf-477a-af1e-22603bb78851-maas-api-tls\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:53.718127 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.718134 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52mb7\" (UniqueName: \"kubernetes.io/projected/c443a009-a2bf-477a-af1e-22603bb78851-kube-api-access-52mb7\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:53.718394 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:53.718143 4498 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c443a009-a2bf-477a-af1e-22603bb78851-openshift-service-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:35:54.001788 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.001695 4498 generic.go:356] "Generic (PLEG): container finished" podID="c443a009-a2bf-477a-af1e-22603bb78851" containerID="4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765" exitCode=0 Oct 30 13:35:54.001788 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.001749 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" Oct 30 13:35:54.002016 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.001755 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" event={"ID":"c443a009-a2bf-477a-af1e-22603bb78851","Type":"ContainerDied","Data":"4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765"} Oct 30 13:35:54.002016 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.001860 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c48877c75-c78xj" event={"ID":"c443a009-a2bf-477a-af1e-22603bb78851","Type":"ContainerDied","Data":"b62f2439e8c40bbe04c2a5f742d798774b4e4baa8bbcb3d17ba9c83dd03fa40e"} Oct 30 13:35:54.002016 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.001883 4498 scope.go:122] "RemoveContainer" containerID="4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765" Oct 30 13:35:54.010928 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.010910 4498 scope.go:122] "RemoveContainer" containerID="4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765" Oct 30 13:35:54.011176 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:35:54.011155 4498 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765\": container with ID starting with 4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765 not found: ID does not exist" containerID="4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765" Oct 30 13:35:54.011251 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.011185 4498 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765"} err="failed to get container status \"4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765\": rpc error: code = NotFound desc = could not find container \"4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765\": container with ID starting with 4d6f613b1608687519bae7d58a4d9ddd8ab98293e66563551636fec5a97cb765 not found: ID does not exist" Oct 30 13:35:54.048142 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.048104 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-c78xj"] Oct 30 13:35:54.058585 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.058556 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c48877c75-c78xj"] Oct 30 13:35:54.900075 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:35:54.900044 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c443a009-a2bf-477a-af1e-22603bb78851" path="/var/lib/kubelet/pods/c443a009-a2bf-477a-af1e-22603bb78851/volumes" Oct 30 13:35:59.827833 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:35:59.827782 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:36:00.716415 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:00.716355 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 30 13:36:00.716764 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:00.716443 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 30 13:36:05.106341 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106310 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7"] Oct 30 13:36:05.106735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106636 4498 cpu_manager.go:414] "containerMap: removing container" podUID="c443a009-a2bf-477a-af1e-22603bb78851" containerName="maas-api" Oct 30 13:36:05.106735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106647 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c443a009-a2bf-477a-af1e-22603bb78851" containerName="maas-api" Oct 30 13:36:05.106735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106663 4498 cpu_manager.go:414] "containerMap: removing container" podUID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" containerName="main" Oct 30 13:36:05.106735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106667 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" containerName="main" Oct 30 13:36:05.106735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106718 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="c443a009-a2bf-477a-af1e-22603bb78851" containerName="maas-api" Oct 30 13:36:05.106735 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.106725 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="14ab0a40-8740-4b6f-9913-25cd9cc93ff0" containerName="main" Oct 30 13:36:05.109510 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.109492 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.122986 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.122967 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 13:36:05.133312 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.133270 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 13:36:05.133312 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.133299 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 13:36:05.135442 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.135420 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7"] Oct 30 13:36:05.223067 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.223042 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9z57\"" Oct 30 13:36:05.249444 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.249419 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.249568 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.249448 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkwr7\" (UniqueName: \"kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.249568 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.249471 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.350290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.350262 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.350290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.350293 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkwr7\" (UniqueName: \"kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.350523 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.350314 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.350904 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.350884 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.352822 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.352792 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.372996 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.372949 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkwr7\" (UniqueName: \"kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7\") pod \"maas-api-revoke-sub-f03629db-jcjn7\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.421036 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.421009 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:05.717291 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.717260 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7"] Oct 30 13:36:05.720633 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:36:05.720607 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b818bc2_13a4_42e8_a8ee_49e181652dd6.slice/crio-44bc6ebbd8fb9834de2f38d8747704dd9829715d5c43ca0e487642f9c5e005d0 WatchSource:0}: Error finding container 44bc6ebbd8fb9834de2f38d8747704dd9829715d5c43ca0e487642f9c5e005d0: Status 404 returned error can't find the container with id 44bc6ebbd8fb9834de2f38d8747704dd9829715d5c43ca0e487642f9c5e005d0 Oct 30 13:36:05.722395 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:05.722375 4498 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 13:36:06.051952 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:06.051880 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" event={"ID":"5b818bc2-13a4-42e8-a8ee-49e181652dd6","Type":"ContainerStarted","Data":"44bc6ebbd8fb9834de2f38d8747704dd9829715d5c43ca0e487642f9c5e005d0"} Oct 30 13:36:08.068148 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:08.068109 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" event={"ID":"5b818bc2-13a4-42e8-a8ee-49e181652dd6","Type":"ContainerStarted","Data":"0ae869415401e613d006bdefe42ae1420fa22f1abe55c5b5a21bf9c727491b6f"} Oct 30 13:36:08.106390 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:08.106286 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" podStartSLOduration=1.247465244 podStartE2EDuration="3.106272972s" totalImagesPullingTime="1.858807728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:36:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:36:08.105383046 +0000 UTC m=+2343.335666182" watchObservedRunningTime="2026-10-30 13:36:08.106272972 +0000 UTC m=+2343.336556106" Oct 30 13:36:09.074016 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:09.073979 4498 generic.go:356] "Generic (PLEG): container finished" podID="5b818bc2-13a4-42e8-a8ee-49e181652dd6" containerID="0ae869415401e613d006bdefe42ae1420fa22f1abe55c5b5a21bf9c727491b6f" exitCode=0 Oct 30 13:36:09.074481 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:09.074033 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" event={"ID":"5b818bc2-13a4-42e8-a8ee-49e181652dd6","Type":"ContainerDied","Data":"0ae869415401e613d006bdefe42ae1420fa22f1abe55c5b5a21bf9c727491b6f"} Oct 30 13:36:10.208828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.208803 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:10.297036 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.296999 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7\" (UniqueName: \"kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7\") pod \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " Oct 30 13:36:10.297257 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.297068 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca\") pod \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " Oct 30 13:36:10.297257 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.297102 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca\") pod \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\" (UID: \"5b818bc2-13a4-42e8-a8ee-49e181652dd6\") " Oct 30 13:36:10.297528 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.297501 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca" pod "5b818bc2-13a4-42e8-a8ee-49e181652dd6" (UID: "5b818bc2-13a4-42e8-a8ee-49e181652dd6"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:36:10.299316 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.299294 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca" pod "5b818bc2-13a4-42e8-a8ee-49e181652dd6" (UID: "5b818bc2-13a4-42e8-a8ee-49e181652dd6"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:36:10.299454 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.299433 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7" pod "5b818bc2-13a4-42e8-a8ee-49e181652dd6" (UID: "5b818bc2-13a4-42e8-a8ee-49e181652dd6"). InnerVolumeSpecName "kube-api-access-mkwr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:36:10.397985 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.397903 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkwr7\" (UniqueName: \"kubernetes.io/projected/5b818bc2-13a4-42e8-a8ee-49e181652dd6-kube-api-access-mkwr7\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:10.397985 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.397930 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-openshift-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:10.397985 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:10.397940 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5b818bc2-13a4-42e8-a8ee-49e181652dd6-maas-api-xks-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:11.083393 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:11.083349 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" event={"ID":"5b818bc2-13a4-42e8-a8ee-49e181652dd6","Type":"ContainerDied","Data":"44bc6ebbd8fb9834de2f38d8747704dd9829715d5c43ca0e487642f9c5e005d0"} Oct 30 13:36:11.083393 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:11.083377 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7" Oct 30 13:36:11.083616 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:11.083402 4498 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44bc6ebbd8fb9834de2f38d8747704dd9829715d5c43ca0e487642f9c5e005d0" Oct 30 13:36:22.151306 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.151275 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx"] Oct 30 13:36:22.151778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.151600 4498 cpu_manager.go:414] "containerMap: removing container" podUID="5b818bc2-13a4-42e8-a8ee-49e181652dd6" containerName="revoke-keys" Oct 30 13:36:22.151778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.151611 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b818bc2-13a4-42e8-a8ee-49e181652dd6" containerName="revoke-keys" Oct 30 13:36:22.151778 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.151670 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b818bc2-13a4-42e8-a8ee-49e181652dd6" containerName="revoke-keys" Oct 30 13:36:22.154694 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.154675 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.172490 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.172463 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 13:36:22.173703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.173684 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 13:36:22.182958 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.182932 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 13:36:22.183151 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.183001 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9z57\"" Oct 30 13:36:22.184726 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.184708 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx"] Oct 30 13:36:22.223627 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.223600 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.223777 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.223640 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5xj\" (UniqueName: \"kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.223777 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.223717 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.324270 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.324231 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.324472 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.324279 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5xj\" (UniqueName: \"kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.324472 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.324308 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.324892 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.324864 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.326750 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.326732 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.346386 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.346361 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5xj\" (UniqueName: \"kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj\") pod \"maas-api-revoke-sub-0165d7d2-b99tx\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.470223 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.470168 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:22.770962 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:22.770834 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx"] Oct 30 13:36:22.775041 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:36:22.775004 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56840383_6caa_4903_975e_7f8a69eabb6a.slice/crio-8778b1b5a63fc1ffd9dbc38527a13595fa34738d12ae0e51654c578e6a913a8b WatchSource:0}: Error finding container 8778b1b5a63fc1ffd9dbc38527a13595fa34738d12ae0e51654c578e6a913a8b: Status 404 returned error can't find the container with id 8778b1b5a63fc1ffd9dbc38527a13595fa34738d12ae0e51654c578e6a913a8b Oct 30 13:36:23.141241 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:23.141137 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" event={"ID":"56840383-6caa-4903-975e-7f8a69eabb6a","Type":"ContainerStarted","Data":"b7be311b25ecfd641b705ffee9ca5f3d6640f6bdbf05ce2296aaad700b976061"} Oct 30 13:36:23.141241 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:23.141185 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" event={"ID":"56840383-6caa-4903-975e-7f8a69eabb6a","Type":"ContainerStarted","Data":"8778b1b5a63fc1ffd9dbc38527a13595fa34738d12ae0e51654c578e6a913a8b"} Oct 30 13:36:23.180520 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:23.180470 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" podStartSLOduration=1.180454505 podStartE2EDuration="1.180454505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:36:23.179191663 +0000 UTC m=+2358.409474798" watchObservedRunningTime="2026-10-30 13:36:23.180454505 +0000 UTC m=+2358.410737639" Oct 30 13:36:24.147220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:24.147169 4498 generic.go:356] "Generic (PLEG): container finished" podID="56840383-6caa-4903-975e-7f8a69eabb6a" containerID="b7be311b25ecfd641b705ffee9ca5f3d6640f6bdbf05ce2296aaad700b976061" exitCode=0 Oct 30 13:36:24.147427 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:24.147258 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" event={"ID":"56840383-6caa-4903-975e-7f8a69eabb6a","Type":"ContainerDied","Data":"b7be311b25ecfd641b705ffee9ca5f3d6640f6bdbf05ce2296aaad700b976061"} Oct 30 13:36:25.286347 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.286318 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:25.345527 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.345496 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca\") pod \"56840383-6caa-4903-975e-7f8a69eabb6a\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " Oct 30 13:36:25.345685 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.345540 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca\") pod \"56840383-6caa-4903-975e-7f8a69eabb6a\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " Oct 30 13:36:25.345685 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.345647 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj\" (UniqueName: \"kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj\") pod \"56840383-6caa-4903-975e-7f8a69eabb6a\" (UID: \"56840383-6caa-4903-975e-7f8a69eabb6a\") " Oct 30 13:36:25.345905 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.345877 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca" pod "56840383-6caa-4903-975e-7f8a69eabb6a" (UID: "56840383-6caa-4903-975e-7f8a69eabb6a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:36:25.347730 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.347707 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca" pod "56840383-6caa-4903-975e-7f8a69eabb6a" (UID: "56840383-6caa-4903-975e-7f8a69eabb6a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:36:25.347851 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.347809 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj" pod "56840383-6caa-4903-975e-7f8a69eabb6a" (UID: "56840383-6caa-4903-975e-7f8a69eabb6a"). InnerVolumeSpecName "kube-api-access-mp5xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:36:25.446914 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.446878 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp5xj\" (UniqueName: \"kubernetes.io/projected/56840383-6caa-4903-975e-7f8a69eabb6a-kube-api-access-mp5xj\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:25.446914 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.446908 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-openshift-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:25.446914 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:25.446919 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/56840383-6caa-4903-975e-7f8a69eabb6a-maas-api-xks-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:26.156451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:26.156416 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" event={"ID":"56840383-6caa-4903-975e-7f8a69eabb6a","Type":"ContainerDied","Data":"8778b1b5a63fc1ffd9dbc38527a13595fa34738d12ae0e51654c578e6a913a8b"} Oct 30 13:36:26.156451 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:26.156451 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx" Oct 30 13:36:26.156714 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:26.156463 4498 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8778b1b5a63fc1ffd9dbc38527a13595fa34738d12ae0e51654c578e6a913a8b" Oct 30 13:36:29.775184 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:36:29.775142 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:36:33.182646 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.182611 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps"] Oct 30 13:36:33.183281 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.183094 4498 cpu_manager.go:414] "containerMap: removing container" podUID="56840383-6caa-4903-975e-7f8a69eabb6a" containerName="revoke-keys" Oct 30 13:36:33.183281 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.183113 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="56840383-6caa-4903-975e-7f8a69eabb6a" containerName="revoke-keys" Oct 30 13:36:33.183281 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.183241 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="56840383-6caa-4903-975e-7f8a69eabb6a" containerName="revoke-keys" Oct 30 13:36:33.185907 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.185887 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.198832 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.198814 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Oct 30 13:36:33.207264 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.207239 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.207406 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.207300 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.207473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.207450 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpr88\" (UniqueName: \"kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.209219 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.209182 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Oct 30 13:36:33.209374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.209242 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p9z57\"" Oct 30 13:36:33.209374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.209316 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Oct 30 13:36:33.211549 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.211526 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps"] Oct 30 13:36:33.308034 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.307997 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpr88\" (UniqueName: \"kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.308261 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.308063 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.308261 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.308123 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.308833 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.308802 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.310610 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.310589 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.330556 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.330523 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpr88\" (UniqueName: \"kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88\") pod \"maas-api-revoke-sub-6b19338f-khnps\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.498605 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.498515 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:33.795962 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:33.795870 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps"] Oct 30 13:36:33.802898 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:36:33.802864 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb13ecec_91fe_49d4_ac3b_38360b560724.slice/crio-06ab86523cae690639d022756aa2ae83584a30677b93267eb0eaf9c93052a440 WatchSource:0}: Error finding container 06ab86523cae690639d022756aa2ae83584a30677b93267eb0eaf9c93052a440: Status 404 returned error can't find the container with id 06ab86523cae690639d022756aa2ae83584a30677b93267eb0eaf9c93052a440 Oct 30 13:36:34.190998 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:34.190959 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" event={"ID":"eb13ecec-91fe-49d4-ac3b-38360b560724","Type":"ContainerStarted","Data":"57327ba29aed9e632e91807f22dced36a0467a72b8a923d4bca7be0ed7592876"} Oct 30 13:36:34.191425 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:34.191026 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" event={"ID":"eb13ecec-91fe-49d4-ac3b-38360b560724","Type":"ContainerStarted","Data":"06ab86523cae690639d022756aa2ae83584a30677b93267eb0eaf9c93052a440"} Oct 30 13:36:34.228759 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:34.228699 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" podStartSLOduration=1.228680273 podStartE2EDuration="1.228680273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:36:34.227902557 +0000 UTC m=+2369.458185693" watchObservedRunningTime="2026-10-30 13:36:34.228680273 +0000 UTC m=+2369.458963410" Oct 30 13:36:35.197374 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:35.197343 4498 generic.go:356] "Generic (PLEG): container finished" podID="eb13ecec-91fe-49d4-ac3b-38360b560724" containerID="57327ba29aed9e632e91807f22dced36a0467a72b8a923d4bca7be0ed7592876" exitCode=0 Oct 30 13:36:35.197780 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:35.197388 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" event={"ID":"eb13ecec-91fe-49d4-ac3b-38360b560724","Type":"ContainerDied","Data":"57327ba29aed9e632e91807f22dced36a0467a72b8a923d4bca7be0ed7592876"} Oct 30 13:36:36.332596 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.332573 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:36.435113 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.435078 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca\") pod \"eb13ecec-91fe-49d4-ac3b-38360b560724\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " Oct 30 13:36:36.435297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.435118 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88\" (UniqueName: \"kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88\") pod \"eb13ecec-91fe-49d4-ac3b-38360b560724\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " Oct 30 13:36:36.435297 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.435141 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca\") pod \"eb13ecec-91fe-49d4-ac3b-38360b560724\" (UID: \"eb13ecec-91fe-49d4-ac3b-38360b560724\") " Oct 30 13:36:36.435537 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.435514 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca" pod "eb13ecec-91fe-49d4-ac3b-38360b560724" (UID: "eb13ecec-91fe-49d4-ac3b-38360b560724"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:36:36.437392 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.437364 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca" pod "eb13ecec-91fe-49d4-ac3b-38360b560724" (UID: "eb13ecec-91fe-49d4-ac3b-38360b560724"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Oct 30 13:36:36.437562 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.437542 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88" pod "eb13ecec-91fe-49d4-ac3b-38360b560724" (UID: "eb13ecec-91fe-49d4-ac3b-38360b560724"). InnerVolumeSpecName "kube-api-access-bpr88". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:36:36.535912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.535838 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-xks-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:36.535912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.535865 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpr88\" (UniqueName: \"kubernetes.io/projected/eb13ecec-91fe-49d4-ac3b-38360b560724-kube-api-access-bpr88\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:36.535912 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:36.535875 4498 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb13ecec-91fe-49d4-ac3b-38360b560724-maas-api-openshift-ca\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:36:37.209967 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:37.209938 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" Oct 30 13:36:37.210137 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:37.209930 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps" event={"ID":"eb13ecec-91fe-49d4-ac3b-38360b560724","Type":"ContainerDied","Data":"06ab86523cae690639d022756aa2ae83584a30677b93267eb0eaf9c93052a440"} Oct 30 13:36:37.210137 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:36:37.210064 4498 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06ab86523cae690639d022756aa2ae83584a30677b93267eb0eaf9c93052a440" Oct 30 13:36:59.774742 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:36:59.774700 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:37:05.097251 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:05.097220 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:37:05.098515 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:05.098496 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:37:29.783232 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:37:29.783175 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:37:36.220371 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:36.220342 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-jndx8_07880807-333e-468c-82a0-3847f2062b8d/manager/0.log" Oct 30 13:37:36.657811 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:36.657730 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-hggtx_2e05590f-1fb3-4b1e-915a-fa6be34519cf/manager/0.log" Oct 30 13:37:37.154787 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:37.154759 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-pd49g_cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11/server/0.log" Oct 30 13:37:37.818959 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:37.818928 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d4d4766b-2zvqz_aee0a704-54d8-46c7-b650-f65f85722ed1/copy-manifests/0.log" Oct 30 13:37:37.852400 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:37.852367 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d4d4766b-2zvqz_aee0a704-54d8-46c7-b650-f65f85722ed1/manager/0.log" Oct 30 13:37:49.849084 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:49.849053 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-b99tx_56840383-6caa-4903-975e-7f8a69eabb6a/revoke-keys/0.log" Oct 30 13:37:50.447125 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:37:50.447097 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-khnps_eb13ecec-91fe-49d4-ac3b-38360b560724/revoke-keys/0.log" Oct 30 13:37:59.774248 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:37:59.774187 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:38:01.035268 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:01.035234 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-jcjn7_5b818bc2-13a4-42e8-a8ee-49e181652dd6/revoke-keys/0.log" Oct 30 13:38:13.729652 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:13.729611 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-7wsh8_5b1d5417-c710-4132-879b-ba54c9b5e1b5/manager/0.log" Oct 30 13:38:14.955710 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:14.955682 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-74848_51eb5efa-7194-41c4-a4ed-ef9963a9d5b0/istio-proxy/0.log" Oct 30 13:38:15.943345 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:15.943317 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-92wlp_59f28a91-b3fe-4fbb-ae03-651541d3510a/istio-proxy/0.log" Oct 30 13:38:26.983145 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:26.983075 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-wntck_7f5b3e5d-ae64-4bdb-b068-69f937f5bd00/istio-proxy/1.log" Oct 30 13:38:27.413539 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:27.413453 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-zbh6t_eb3a6c12-03bd-4ea8-88ae-95605bda0e31/istio-proxy/0.log" Oct 30 13:38:28.673852 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:38:28.673816 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-wntck_7f5b3e5d-ae64-4bdb-b068-69f937f5bd00/istio-proxy/0.log" Oct 30 13:38:29.774367 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:38:29.774312 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:38:59.775062 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:38:59.775026 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:39:01.200884 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:01.200844 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-jndx8_07880807-333e-468c-82a0-3847f2062b8d/manager/0.log" Oct 30 13:39:01.643571 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:01.643488 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-hggtx_2e05590f-1fb3-4b1e-915a-fa6be34519cf/manager/0.log" Oct 30 13:39:02.122551 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:02.122525 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-pd49g_cb6d6f45-30ae-43c5-b8b7-2f2ac01a7a11/server/0.log" Oct 30 13:39:02.795461 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:02.795429 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d4d4766b-2zvqz_aee0a704-54d8-46c7-b650-f65f85722ed1/copy-manifests/0.log" Oct 30 13:39:02.831431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:02.831401 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64d4d4766b-2zvqz_aee0a704-54d8-46c7-b650-f65f85722ed1/manager/0.log" Oct 30 13:39:14.553080 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:14.553049 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-b99tx_56840383-6caa-4903-975e-7f8a69eabb6a/revoke-keys/0.log" Oct 30 13:39:15.158219 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:15.158171 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-khnps_eb13ecec-91fe-49d4-ac3b-38360b560724/revoke-keys/0.log" Oct 30 13:39:15.574262 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:15.574238 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-jcjn7_5b818bc2-13a4-42e8-a8ee-49e181652dd6/revoke-keys/0.log" Oct 30 13:39:27.923560 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:27.923526 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-7wsh8_5b1d5417-c710-4132-879b-ba54c9b5e1b5/manager/0.log" Oct 30 13:39:28.995014 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:28.994981 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-74848_51eb5efa-7194-41c4-a4ed-ef9963a9d5b0/istio-proxy/0.log" Oct 30 13:39:29.775399 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:39:29.775354 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:39:30.001656 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:30.001623 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-92wlp_59f28a91-b3fe-4fbb-ae03-651541d3510a/istio-proxy/0.log" Oct 30 13:39:31.005337 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:31.005306 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-wntck_7f5b3e5d-ae64-4bdb-b068-69f937f5bd00/istio-proxy/1.log" Oct 30 13:39:31.401703 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:39:31.401626 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-zbh6t_eb3a6c12-03bd-4ea8-88ae-95605bda0e31/istio-proxy/0.log" Oct 30 13:39:59.774794 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:39:59.774713 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:40:29.775094 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:40:29.775058 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:40:59.774996 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:40:59.774958 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:41:11.036578 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:11.036540 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7"] Oct 30 13:41:11.046502 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:11.046473 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-jcjn7"] Oct 30 13:41:12.899069 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:12.899032 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b818bc2-13a4-42e8-a8ee-49e181652dd6" path="/var/lib/kubelet/pods/5b818bc2-13a4-42e8-a8ee-49e181652dd6/volumes" Oct 30 13:41:26.045431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:26.045357 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx"] Oct 30 13:41:26.055304 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:26.055274 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-b99tx"] Oct 30 13:41:26.898944 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:26.898916 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="56840383-6caa-4903-975e-7f8a69eabb6a" path="/var/lib/kubelet/pods/56840383-6caa-4903-975e-7f8a69eabb6a/volumes" Oct 30 13:41:29.774389 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:41:29.774353 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:41:37.031260 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:37.031226 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps"] Oct 30 13:41:37.041341 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:37.041316 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-khnps"] Oct 30 13:41:38.898951 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:41:38.898916 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb13ecec-91fe-49d4-ac3b-38360b560724" path="/var/lib/kubelet/pods/eb13ecec-91fe-49d4-ac3b-38360b560724/volumes" Oct 30 13:41:59.774169 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:41:59.774132 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:42:04.600879 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.600849 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sstkl/must-gather-znfjb"] Oct 30 13:42:04.601325 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.601180 4498 cpu_manager.go:414] "containerMap: removing container" podUID="eb13ecec-91fe-49d4-ac3b-38360b560724" containerName="revoke-keys" Oct 30 13:42:04.601325 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.601210 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb13ecec-91fe-49d4-ac3b-38360b560724" containerName="revoke-keys" Oct 30 13:42:04.601325 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.601297 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb13ecec-91fe-49d4-ac3b-38360b560724" containerName="revoke-keys" Oct 30 13:42:04.604317 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.604298 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.627192 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.627158 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sstkl\"/\"default-dockercfg-57nhp\"" Oct 30 13:42:04.627341 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.627253 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sstkl\"/\"kube-root-ca.crt\"" Oct 30 13:42:04.637499 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.637475 4498 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sstkl\"/\"openshift-service-ca.crt\"" Oct 30 13:42:04.651033 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.651005 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c42672b6-7285-4ed3-9349-f0714c38e3f0-must-gather-output\") pod \"must-gather-znfjb\" (UID: \"c42672b6-7285-4ed3-9349-f0714c38e3f0\") " pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.651151 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.651062 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwfk4\" (UniqueName: \"kubernetes.io/projected/c42672b6-7285-4ed3-9349-f0714c38e3f0-kube-api-access-rwfk4\") pod \"must-gather-znfjb\" (UID: \"c42672b6-7285-4ed3-9349-f0714c38e3f0\") " pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.666751 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.666724 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sstkl/must-gather-znfjb"] Oct 30 13:42:04.751876 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.751843 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c42672b6-7285-4ed3-9349-f0714c38e3f0-must-gather-output\") pod \"must-gather-znfjb\" (UID: \"c42672b6-7285-4ed3-9349-f0714c38e3f0\") " pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.752055 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.751908 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwfk4\" (UniqueName: \"kubernetes.io/projected/c42672b6-7285-4ed3-9349-f0714c38e3f0-kube-api-access-rwfk4\") pod \"must-gather-znfjb\" (UID: \"c42672b6-7285-4ed3-9349-f0714c38e3f0\") " pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.752228 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.752180 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c42672b6-7285-4ed3-9349-f0714c38e3f0-must-gather-output\") pod \"must-gather-znfjb\" (UID: \"c42672b6-7285-4ed3-9349-f0714c38e3f0\") " pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.773545 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.773516 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwfk4\" (UniqueName: \"kubernetes.io/projected/c42672b6-7285-4ed3-9349-f0714c38e3f0-kube-api-access-rwfk4\") pod \"must-gather-znfjb\" (UID: \"c42672b6-7285-4ed3-9349-f0714c38e3f0\") " pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:04.930177 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.930157 4498 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sstkl\"/\"default-dockercfg-57nhp\"" Oct 30 13:42:04.938254 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:04.938231 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sstkl/must-gather-znfjb" Oct 30 13:42:05.127260 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:05.127231 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:42:05.128812 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:05.128794 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9n64_b5d62fac-0db6-4150-b580-cc42eac91fb1/ovn-acl-logging/0.log" Oct 30 13:42:05.253617 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:05.253537 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sstkl/must-gather-znfjb"] Oct 30 13:42:05.257847 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:42:05.257819 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc42672b6_7285_4ed3_9349_f0714c38e3f0.slice/crio-70ce0e6e3ce61c10307a5e1b4ab9751d87f448a7d4716378cfa1bb87a37692e3 WatchSource:0}: Error finding container 70ce0e6e3ce61c10307a5e1b4ab9751d87f448a7d4716378cfa1bb87a37692e3: Status 404 returned error can't find the container with id 70ce0e6e3ce61c10307a5e1b4ab9751d87f448a7d4716378cfa1bb87a37692e3 Oct 30 13:42:05.259767 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:05.259747 4498 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 30 13:42:05.594634 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:05.594542 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sstkl/must-gather-znfjb" event={"ID":"c42672b6-7285-4ed3-9349-f0714c38e3f0","Type":"ContainerStarted","Data":"70ce0e6e3ce61c10307a5e1b4ab9751d87f448a7d4716378cfa1bb87a37692e3"} Oct 30 13:42:06.606186 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:06.606143 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sstkl/must-gather-znfjb" event={"ID":"c42672b6-7285-4ed3-9349-f0714c38e3f0","Type":"ContainerStarted","Data":"13acde998c6aa4fed366aed722adf445773fb89004c89d88fdafca93b2c4c6a9"} Oct 30 13:42:06.606706 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:06.606222 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sstkl/must-gather-znfjb" event={"ID":"c42672b6-7285-4ed3-9349-f0714c38e3f0","Type":"ContainerStarted","Data":"e57f367a41fb7e73a3fb6658cc5d1d34fa216d9c2b1160ee1f4630757e54c951"} Oct 30 13:42:06.644561 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:06.644506 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-sstkl/must-gather-znfjb" podStartSLOduration=1.907750906 podStartE2EDuration="2.644492587s" totalImagesPullingTime="736.741681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 13:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:42:06.643596094 +0000 UTC m=+2701.873879229" watchObservedRunningTime="2026-10-30 13:42:06.644492587 +0000 UTC m=+2701.874775722" Oct 30 13:42:09.179119 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:09.179088 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gwd9f_774297e4-0a5c-458f-8d10-ecffd469fce1/global-pull-secret-syncer/0.log" Oct 30 13:42:09.447738 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:09.447691 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck"] Oct 30 13:42:09.447966 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:09.447939 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" containerID="cri-o://33f296d103afae97e70ec9480cce337c6ed0c3a7925f610efcb8205af35b4416" gracePeriod=30 Oct 30 13:42:09.458075 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:09.458046 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp"] Oct 30 13:42:09.458285 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:09.458266 4498 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" containerID="cri-o://557cf9f38e249432063321f4a8b021dea946410fcd3493adbf0a385cd1a6d051" gracePeriod=30 Oct 30 13:42:10.034219 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:10.033932 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-wntck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Oct 30 13:42:10.034219 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:10.034006 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Oct 30 13:42:10.116218 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:10.114427 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fnn4j_f2bd8658-22fb-4aa8-a657-a363578881a8/konnectivity-agent/0.log" Oct 30 13:42:10.537217 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:10.532974 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-34.ec2.internal_ed215bcf2fbe8974076cda59d8c09a02/haproxy/0.log" Oct 30 13:42:14.670150 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.670119 4498 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-c9ffffc7f-92wlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Oct 30 13:42:14.670839 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.670788 4498 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Oct 30 13:42:14.733274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.730664 4498 generic.go:356] "Generic (PLEG): container finished" podID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerID="33f296d103afae97e70ec9480cce337c6ed0c3a7925f610efcb8205af35b4416" exitCode=0 Oct 30 13:42:14.733274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.730835 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" event={"ID":"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00","Type":"ContainerDied","Data":"33f296d103afae97e70ec9480cce337c6ed0c3a7925f610efcb8205af35b4416"} Oct 30 13:42:14.733274 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.730910 4498 scope.go:122] "RemoveContainer" containerID="e7b8df9b598383e7658891a7412e937a62bafec97f6a21f35da466ad3ea4567d" Oct 30 13:42:14.739431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.737280 4498 generic.go:356] "Generic (PLEG): container finished" podID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerID="557cf9f38e249432063321f4a8b021dea946410fcd3493adbf0a385cd1a6d051" exitCode=0 Oct 30 13:42:14.739431 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.737336 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" event={"ID":"59f28a91-b3fe-4fbb-ae03-651541d3510a","Type":"ContainerDied","Data":"557cf9f38e249432063321f4a8b021dea946410fcd3493adbf0a385cd1a6d051"} Oct 30 13:42:14.874355 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.873855 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:42:14.885286 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.884026 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963663 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963721 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963755 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963798 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963834 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963867 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963900 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963927 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963958 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.963999 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964049 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964077 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964128 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964155 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964186 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert\") pod \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\" (UID: \"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964243 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964278 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.966220 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.964304 4498 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token\") pod \"59f28a91-b3fe-4fbb-ae03-651541d3510a\" (UID: \"59f28a91-b3fe-4fbb-ae03-651541d3510a\") " Oct 30 13:42:14.970466 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.968843 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.970466 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.969525 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:42:14.970466 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.970163 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Oct 30 13:42:14.971050 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.970997 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.973455 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.973429 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.977226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.973607 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.977226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.976388 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.977226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.976542 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.977226 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.976688 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.981265 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.979567 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:42:14.981265 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.979794 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:14.986849 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.983511 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:42:14.986849 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:14.983824 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Oct 30 13:42:15.012454 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.009420 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:15.012454 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.010518 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw" pod "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" (UID: "7f5b3e5d-ae64-4bdb-b068-69f937f5bd00"). InnerVolumeSpecName "kube-api-access-sp6rw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:42:15.012454 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.010532 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "kube-api-access-9kbpd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:42:15.012454 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.011315 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Oct 30 13:42:15.013350 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.013324 4498 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy" pod "59f28a91-b3fe-4fbb-ae03-651541d3510a" (UID: "59f28a91-b3fe-4fbb-ae03-651541d3510a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Oct 30 13:42:15.068643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068608 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068645 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068659 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068673 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kbpd\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-kube-api-access-9kbpd\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068687 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068702 4498 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59f28a91-b3fe-4fbb-ae03-651541d3510a-istiod-ca-cert\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068715 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068727 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068742 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068755 4498 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-credential-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068768 4498 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-token\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068781 4498 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-certs\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068794 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068809 4498 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59f28a91-b3fe-4fbb-ae03-651541d3510a-workload-socket\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068824 4498 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-podinfo\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068838 4498 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-data\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068850 4498 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-istio-envoy\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.068919 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.068862 4498 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp6rw\" (UniqueName: \"kubernetes.io/projected/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00-kube-api-access-sp6rw\") on node \"ip-10-0-130-34.ec2.internal\" DevicePath \"\"" Oct 30 13:42:15.743691 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.743607 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" event={"ID":"7f5b3e5d-ae64-4bdb-b068-69f937f5bd00","Type":"ContainerDied","Data":"0fa37965ab2c1907a4e1d8663ee143dd839132d969962576fa7aec4ea358a688"} Oct 30 13:42:15.743691 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.743668 4498 scope.go:122] "RemoveContainer" containerID="33f296d103afae97e70ec9480cce337c6ed0c3a7925f610efcb8205af35b4416" Oct 30 13:42:15.744237 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.743746 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck" Oct 30 13:42:15.757290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.755104 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" event={"ID":"59f28a91-b3fe-4fbb-ae03-651541d3510a","Type":"ContainerDied","Data":"6b64445ef86c7100b40ffdcd55e4f32bb24b37828c4209c25bc4449bef73f046"} Oct 30 13:42:15.757290 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.755242 4498 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp" Oct 30 13:42:15.764490 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.764470 4498 scope.go:122] "RemoveContainer" containerID="557cf9f38e249432063321f4a8b021dea946410fcd3493adbf0a385cd1a6d051" Oct 30 13:42:15.799175 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.798517 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck"] Oct 30 13:42:15.808686 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.808625 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-wntck"] Oct 30 13:42:15.858868 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.858811 4498 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp"] Oct 30 13:42:15.860927 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:15.860900 4498 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c9ffffc7f-92wlp"] Oct 30 13:42:16.902320 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:16.902293 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" path="/var/lib/kubelet/pods/59f28a91-b3fe-4fbb-ae03-651541d3510a/volumes" Oct 30 13:42:16.914225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:16.914173 4498 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" path="/var/lib/kubelet/pods/7f5b3e5d-ae64-4bdb-b068-69f937f5bd00/volumes" Oct 30 13:42:17.169265 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:17.169055 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-57bb9bfff-7wsh8_5b1d5417-c710-4132-879b-ba54c9b5e1b5/manager/0.log" Oct 30 13:42:19.127366 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127328 4498 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4"] Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127685 4498 cpu_manager.go:414] "containerMap: removing container" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127701 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127716 4498 cpu_manager.go:414] "containerMap: removing container" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127721 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127732 4498 cpu_manager.go:414] "containerMap: removing container" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127739 4498 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127818 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127831 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="59f28a91-b3fe-4fbb-ae03-651541d3510a" containerName="istio-proxy" Oct 30 13:42:19.127943 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.127841 4498 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f5b3e5d-ae64-4bdb-b068-69f937f5bd00" containerName="istio-proxy" Oct 30 13:42:19.132473 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.132454 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.149501 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.149474 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-podres\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.149643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.149520 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-proc\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.149643 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.149611 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-lib-modules\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.149749 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.149719 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-sys\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.149793 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.149776 4498 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclc9\" (UniqueName: \"kubernetes.io/projected/66032daf-f06a-44a5-b0c0-14287315c114-kube-api-access-xclc9\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.159721 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.159691 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4"] Oct 30 13:42:19.251137 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251096 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-podres\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251349 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251238 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-proc\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251349 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251254 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-podres\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251349 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251326 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-proc\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251349 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251347 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-lib-modules\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251583 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251381 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-sys\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251583 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251415 4498 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclc9\" (UniqueName: \"kubernetes.io/projected/66032daf-f06a-44a5-b0c0-14287315c114-kube-api-access-xclc9\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251583 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251476 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-lib-modules\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.251583 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.251499 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66032daf-f06a-44a5-b0c0-14287315c114-sys\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.273872 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.273841 4498 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclc9\" (UniqueName: \"kubernetes.io/projected/66032daf-f06a-44a5-b0c0-14287315c114-kube-api-access-xclc9\") pod \"perf-node-gather-daemonset-bktj4\" (UID: \"66032daf-f06a-44a5-b0c0-14287315c114\") " pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.445750 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.445706 4498 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:19.757315 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.757228 4498 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4"] Oct 30 13:42:19.766890 ip-10-0-130-34 kubenswrapper[4498]: W1030 13:42:19.766863 4498 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66032daf_f06a_44a5_b0c0_14287315c114.slice/crio-34d42c8f123b36ad6a389dd62a9ef58fd91c85109bd26aa597b6388271a54a90 WatchSource:0}: Error finding container 34d42c8f123b36ad6a389dd62a9ef58fd91c85109bd26aa597b6388271a54a90: Status 404 returned error can't find the container with id 34d42c8f123b36ad6a389dd62a9ef58fd91c85109bd26aa597b6388271a54a90 Oct 30 13:42:19.797254 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:19.797184 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" event={"ID":"66032daf-f06a-44a5-b0c0-14287315c114","Type":"ContainerStarted","Data":"34d42c8f123b36ad6a389dd62a9ef58fd91c85109bd26aa597b6388271a54a90"} Oct 30 13:42:20.407238 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:20.407171 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79xb9_5dc88003-99f6-424c-bf3e-37d4c0b1d57e/node-exporter/0.log" Oct 30 13:42:20.526519 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:20.526488 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79xb9_5dc88003-99f6-424c-bf3e-37d4c0b1d57e/kube-rbac-proxy/0.log" Oct 30 13:42:20.645669 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:20.645640 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-79xb9_5dc88003-99f6-424c-bf3e-37d4c0b1d57e/init-textfile/0.log" Oct 30 13:42:20.802883 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:20.802849 4498 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" event={"ID":"66032daf-f06a-44a5-b0c0-14287315c114","Type":"ContainerStarted","Data":"a201804a5f0a3989c1a282d16a9d922b41e7abde1818839a0890f88ed3827190"} Oct 30 13:42:20.803073 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:20.802980 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:20.839966 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:20.839878 4498 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" podStartSLOduration=1.839862933 podStartE2EDuration="1.839862933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 13:42:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 13:42:20.839107039 +0000 UTC m=+2716.069390175" watchObservedRunningTime="2026-10-30 13:42:20.839862933 +0000 UTC m=+2716.070146067" Oct 30 13:42:22.894000 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:22.893972 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-8zp58_f273c797-0f60-46c7-9b27-61141af2819f/prometheus-operator-admission-webhook/0.log" Oct 30 13:42:26.819129 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:26.819096 4498 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sstkl/perf-node-gather-daemonset-bktj4" Oct 30 13:42:27.537485 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:27.537457 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-784fdc9f45-5pn68_a897b056-476b-4ea0-918d-96762f60c5f3/console/0.log" Oct 30 13:42:27.673958 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:27.673923 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-s5lqq_06e8a16e-89cf-431d-bc3e-ccb9abcba60d/download-server/0.log" Oct 30 13:42:29.786520 ip-10-0-130-34 kubenswrapper[4498]: E1030 13:42:29.786454 4498 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-95x2c" containerName="extractor" Oct 30 13:42:31.365820 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:31.365789 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-74848_51eb5efa-7194-41c4-a4ed-ef9963a9d5b0/istio-proxy/0.log" Oct 30 13:42:31.916992 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:31.916964 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxnch_c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/dns/0.log" Oct 30 13:42:32.052848 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:32.052805 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lxnch_c36c8a58-e432-4ad3-bb86-bbd4cdc345e5/kube-rbac-proxy/0.log" Oct 30 13:42:32.331619 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:32.331589 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fghs2_2c6f7a0c-5e71-45a1-9eea-e1e1475a3d23/dns-node-resolver/0.log" Oct 30 13:42:32.653087 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:32.653005 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-zbh6t_eb3a6c12-03bd-4ea8-88ae-95605bda0e31/istio-proxy/0.log" Oct 30 13:42:33.591402 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:33.591369 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b8f957dd5-4dxtx_40212d18-1744-46fb-9f7c-f98424a813bb/registry/0.log" Oct 30 13:42:33.937872 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:33.937841 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zp996_6a613faa-490e-4961-b7c3-9e08092e06a5/node-ca/0.log" Oct 30 13:42:35.038225 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:35.038168 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-74848_51eb5efa-7194-41c4-a4ed-ef9963a9d5b0/istio-proxy/0.log" Oct 30 13:42:35.914828 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:35.914794 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-98f7774f-74848_51eb5efa-7194-41c4-a4ed-ef9963a9d5b0/istio-proxy/0.log" Oct 30 13:42:36.346785 ip-10-0-130-34 kubenswrapper[4498]: I1030 13:42:36.346754 4498 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c9ffffc7f-zbh6t_eb3a6c12-03bd-4ea8-88ae-95605bda0e31/istio-proxy/0.log"